-- Logs begin at Fri 2022-05-27 02:23:33 UTC, end at Fri 2022-05-27 03:42:25 UTC. -- May 27 03:14:56.028211 dv-cinder-828807-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:14:56.037293 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:14:56 2022] *** May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: nodename: dv-cinder-828807-4-iscsi May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: machine: x86_64 May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: clock source: unix May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: pcre jit disabled May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: detected number of CPU cores: 4 May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: current working directory: / May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: detected binary path: /usr/bin/uwsgi-core May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: your processes number limit is 47680 May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: your memory page size is 4096 bytes May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: detected max file descriptor number: 2048 May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: lock engine: pthread robust mutexes May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: thunder lock: enabled May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:14:56.039903 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:14:56.083490 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: Python main interpreter initialized at 0x55a8ba4bc9c0 May 27 03:14:56.083490 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: python threads support enabled May 27 03:14:56.083490 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: your server socket listen backlog is limited to 100 connections May 27 03:14:56.083490 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: your mercy for graceful operations on workers is 90 seconds May 27 03:14:56.083811 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:14:56.083927 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: *** Operational MODE: preforking *** May 27 03:14:56.084160 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: *** uWSGI is running in multiple interpreter mode *** May 27 03:14:56.084160 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: spawned uWSGI master process (pid: 103184) May 27 03:14:56.084342 dv-cinder-828807-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:14:56.089191 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: spawned uWSGI worker 1 (pid: 103185, cores: 1) May 27 03:14:56.089191 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: spawned uWSGI worker 2 (pid: 103186, cores: 1) May 27 03:14:56.089191 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:14:57.245644 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:14:57.247773 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:14:57.969554 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:57.969554 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: from cryptography.utils import int_from_bytes May 27 03:14:57.970397 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:57.970397 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: from cryptography.utils import int_from_bytes May 27 03:14:57.970960 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:57.970960 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: from cryptography.utils import int_from_bytes May 27 03:14:57.971483 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:57.971483 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: from cryptography.utils import int_from_bytes May 27 03:15:00.547963 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:15:00.548677 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:15:00.549048 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:15:00.549152 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:15:00.549250 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:15:00.549339 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:15:00.549421 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:15:00.549508 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:15:00.549595 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:15:00.549680 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:15:00.549774 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.549861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.550040 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.550148 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.550354 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.550450 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.550668 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.550769 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.550995 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.551090 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.551301 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.551419 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.551620 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.551720 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.551958 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.552066 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.552285 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.552375 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.552553 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.552661 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.552856 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.552941 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.553175 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-4-iscsi {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.553263 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-4-iscsi {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.553491 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.553588 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.553793 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.553885 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.554095 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.554182 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.554408 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.554496 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.554706 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.554805 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.555022 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.555109 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.555322 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.555464 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.555810 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.555991 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557143 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557143 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557416 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557416 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557678 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557815 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557951 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.557951 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.558222 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.558339 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.558544 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.558673 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.558786 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.558916 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559049 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559183 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559318 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559452 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559577 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559577 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559871 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-4-iscsi {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.559871 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560139 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-4-iscsi {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560285 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560412 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560542 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560662 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560662 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560911 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.560911 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.561176 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.561313 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.561433 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.561574 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.561716 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.561848 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.562102 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.562102 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.562353 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.562489 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.562644 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.562778 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.562910 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.563044 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.563179 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.563323 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.563457 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.563608 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.564261 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.564457 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.564601 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.564762 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.564898 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.565067 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.565197 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.565364 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.565505 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.565666 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.565807 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.565935 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.566075 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.566208 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.566356 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.566483 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.566613 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.566784 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.566914 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.567098 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.567228 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.567356 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.567480 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.567620 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.567764 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.567939 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.568075 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.568202 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.568330 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.568505 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.568643 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.568806 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.568934 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.569106 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.569233 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.569403 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.569547 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.569703 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.569832 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.569997 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.570136 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.570296 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.570431 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.570592 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.570727 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.570890 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.571021 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.571197 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.571336 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.571502 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.571636 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.571803 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.571964 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.572238 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.572379 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.572507 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.572639 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.572754 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.572882 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.573045 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.573174 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.573347 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.573490 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.573680 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.573819 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.573983 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.574110 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.574285 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.574413 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.574868 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.575009 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.575168 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.575302 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.575471 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.575604 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.575771 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.575937 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.576107 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.576273 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.576422 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.576560 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.576723 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.576861 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577000 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577124 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577261 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577383 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577557 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577671 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577857 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.577971 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.578169 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.578302 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.578437 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.578571 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.578737 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.578873 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.579063 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.579202 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.579337 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.580043 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.580174 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.580299 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.580481 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.580620 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.580781 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.580910 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.581080 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.581214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.581377 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.581512 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.581678 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.581813 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.581977 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.582114 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.582389 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.582532 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.582667 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.582806 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.582932 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.583058 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.583193 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.583333 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.583461 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.583586 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.583718 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.583877 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.584088 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.584227 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.584367 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.584495 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.584620 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.584745 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.584908 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.585046 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.585205 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.585336 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.585518 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.585656 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.585817 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.585959 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.586114 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.586256 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.586419 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.586548 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.586715 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.586855 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.587011 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.587148 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.587308 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.587445 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.587601 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.587738 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.587922 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.588055 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.588227 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.588355 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.588530 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.588671 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.588827 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.588964 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.589123 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.589251 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.589421 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.589553 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.589717 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.589844 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.590015 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.590143 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.590311 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.590441 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.590608 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.590743 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.590900 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.591035 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.591211 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.591348 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.591515 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.591644 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.591829 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.591960 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.592132 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.592402 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.592534 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.592665 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.592798 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:15:00.592933 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.593068 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.593196 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.593361 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.593489 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.593699 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.593839 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.594009 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.594137 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.594335 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.594471 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.594648 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.594786 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.594960 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.595088 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.595294 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.595423 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.595604 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.595742 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.595961 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.596098 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.596256 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.596430 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.596568 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.596685 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.596830 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.596956 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.597141 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.597274 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.597450 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.597588 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.597765 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.597894 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.598077 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.598212 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.598392 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.598529 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.598708 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.598844 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.599002 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.599131 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.599313 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.599451 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.599629 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.599763 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.599964 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.600095 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.600268 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.600398 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.600603 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.600745 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.600926 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.601068 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.601235 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.601363 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.601556 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.601692 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.601867 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.602011 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.602170 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.602297 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.602555 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.602687 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.602813 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.602952 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.603086 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.603212 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.603383 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.603521 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.603688 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.603848 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.604023 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.604171 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.604328 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.604465 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.604632 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.604842 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.604972 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.605108 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.605244 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.605377 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.605518 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.605646 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.605831 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.605970 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.606140 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.606272 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.606443 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.606574 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.606746 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.606876 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.607052 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.607180 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.607352 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.607493 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.607655 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.607782 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.607975 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.608102 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.608271 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.608403 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.608569 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.608706 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.608867 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.609005 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.609165 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.609306 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.609461 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.609588 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.609774 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.609922 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.610082 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.610210 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.610381 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.610509 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.610720 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.610860 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.611027 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.611166 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.611328 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.611455 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.611631 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.611771 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.611954 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.612085 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.612255 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.612385 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.612659 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.612802 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.612930 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.613063 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.613182 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.613304 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.613445 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.613573 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.613729 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.613858 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.614027 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.614157 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.614332 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.614462 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.614628 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.614764 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.614926 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.615056 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.615230 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.615360 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.615531 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.615660 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.615847 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.615993 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.616158 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.616297 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.616462 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.616592 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.616772 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.616910 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.617075 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.617203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.617380 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.617519 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.617708 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.617853 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.617992 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.618118 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.618317 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.618447 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.618633 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.618773 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.618945 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.619073 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.619247 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.619376 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.619543 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.619673 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.619859 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.619991 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.620161 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.620289 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.620461 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.620591 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.620757 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.620885 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.621056 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.621191 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.621351 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.621480 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.621652 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.621791 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.621932 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.622074 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.622251 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.622388 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.622523 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.622785 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.622917 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.623053 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.623181 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.623295 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.623418 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.623551 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.623689 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.623876 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.624006 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.624143 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.624301 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.624431 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.624604 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.624745 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.624940 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.625070 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.625269 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.625400 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.625581 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.625723 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.625891 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.626021 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.626194 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.626822 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.627032 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.627170 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.627340 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.627467 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.627646 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.627776 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.627975 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.628117 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.628285 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.628416 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.628591 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.628720 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.628895 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.629024 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.629201 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.629336 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.629505 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.629633 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.629819 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.629950 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.630120 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.630255 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.630421 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.630549 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.630720 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.630856 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.631029 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.631160 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.631365 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.631504 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.631672 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.631801 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.632016 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.632145 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.632321 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.632461 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.632625 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.632901 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633035 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633161 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633286 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633481 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633610 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633736 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633861 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.633994 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.634122 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.634257 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.634391 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.634525 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.634678 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.634816 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.634988 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.635126 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.635291 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.635429 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.635595 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.635724 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.635920 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.636058 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.636224 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.636353 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.636520 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.636649 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.636826 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.636958 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.637145 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.637277 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.637451 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.637579 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.637758 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.637888 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.638060 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.638190 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.638365 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.638502 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.638671 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.638801 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.638972 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.639100 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.639275 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.639412 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.639572 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.639699 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.639895 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.640027 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.640201 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.640344 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.640506 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.640635 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.640807 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.640935 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.641109 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.641254 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.641391 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.641525 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.641696 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.641826 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.642613 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.642741 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643002 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643133 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643260 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643388 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643521 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643656 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643784 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.643941 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.644068 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.644205 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.644341 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.644469 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.644658 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.644789 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.644957 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.645087 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.645256 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.645397 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.645572 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.645703 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.645872 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.646001 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.646166 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.646296 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.646463 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.646593 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.646760 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.646899 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.647094 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.647224 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.647397 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.647527 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.647695 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.647871 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.648029 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.648169 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.648344 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.648482 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.648655 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.648795 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.648965 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.649103 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.649269 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.649408 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.649572 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.649711 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.649888 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.650017 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.650190 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.650317 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.650489 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.650618 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.650793 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.650929 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.651092 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.651227 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.651395 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.651527 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.651697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.651850 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.652028 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.652158 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.652327 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.652464 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.652629 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.652758 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.653054 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.653196 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.653333 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.653470 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.653588 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.653719 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.653847 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.654084 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.654356 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.654495 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.654680 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.654810 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.654988 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.655130 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.655300 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.655431 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.655611 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.655748 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.655944 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.656087 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.656268 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.656399 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.656587 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.656726 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.656893 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.657031 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.657202 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.657417 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.657570 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.657696 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.657828 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.657956 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.658149 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.658291 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.658453 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.658582 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.658752 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.658881 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.659048 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.659185 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.659348 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.659479 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.659646 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.659774 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.659963 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.660109 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.660262 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.660394 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.660560 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.660690 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.660858 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.660990 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.661159 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.661296 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.661454 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.661583 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.661754 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.661892 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.662048 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.662176 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.662362 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.662501 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.662642 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.662769 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.662945 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.663210 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.663344 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.663471 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.663611 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.663726 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.663874 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.664014 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.664164 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.664304 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.664494 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.664626 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.664817 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.664946 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.665121 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.665265 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.665423 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.665562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.665722 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.665850 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.666034 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.666172 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.666329 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.666465 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.666626 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.666767 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.666926 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.667066 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.667228 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.667358 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.667528 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.667658 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.667859 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.667993 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.668148 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.668279 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.668454 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.668593 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.668760 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.668892 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.669060 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.669191 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.669354 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.669482 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.669654 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.669785 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.669948 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.670078 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.670257 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.670388 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.670556 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.670686 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.670851 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.670978 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.671148 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.671287 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.671450 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.671579 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.671749 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.671895 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.672072 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.672216 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.672371 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.672499 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.672664 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.672799 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.672974 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.673273 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.673416 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.673542 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.673668 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.673793 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.673918 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.674058 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.674193 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.674328 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.674455 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.674580 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.674715 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.674842 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.675026 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.675155 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.675328 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.675458 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.675627 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.675759 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.675944 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.676075 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.676245 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.676391 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.676530 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.676657 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.676821 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.676952 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.677124 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.677254 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.677439 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.677571 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.677738 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.677874 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.678031 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.678175 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.678329 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.678457 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.678631 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.678768 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.678926 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.679068 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.679228 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.679356 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.679511 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.679640 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.679804 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.679965 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.680123 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.680263 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.680421 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.680549 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.680716 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.680853 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.681013 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.681143 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.681322 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.681449 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.681621 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.681750 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.681917 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.682039 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.682215 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.682344 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.682507 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.682637 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.682842 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.682981 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.683142 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.683417 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.683562 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.683695 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.683876 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684007 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684144 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684278 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684416 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684544 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684670 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684796 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.684969 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.685177 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.685307 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.685444 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.685574 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.685687 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.685855 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.686006 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.686158 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.686269 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.686456 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.686543 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.686749 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.686845 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.687045 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.687132 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.687357 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.687444 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.687714 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.687853 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.687981 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.688067 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.688296 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.688381 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.688614 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.689182 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.689430 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.689516 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.689730 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.689816 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.690036 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.690122 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.690339 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.690430 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.690642 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.690727 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.690941 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.691027 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.691244 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.691328 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.691545 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.691629 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.691865 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.691967 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.692172 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.692258 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.692475 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.692568 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.692775 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.692869 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.693074 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.693161 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.693376 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.693466 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.693676 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.693761 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.693988 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.694072 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.694288 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.694381 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.694588 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.694675 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.694886 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.694972 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.695181 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.695274 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.695475 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.695559 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.695774 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.695882 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.696095 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.696224 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.696517 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.696602 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.696824 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.696907 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.697125 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.697220 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.697418 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.697502 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.697719 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.697821 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.698020 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.698115 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.698327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.698411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.698627 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.698712 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.698923 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.699043 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.699339 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.699425 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.699929 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.700019 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.700234 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.700321 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.700534 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.700618 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.700829 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.700926 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.701127 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.701215 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.701430 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.701514 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.701735 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.701832 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.702030 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.702115 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.702328 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.702414 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.702623 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.702719 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.702935 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.703020 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.703231 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.703315 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.703546 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.703666 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.703978 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.704101 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.704283 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.704431 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.705200 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.705343 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.705536 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.705675 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.705845 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.705991 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.706167 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.706307 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.706485 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.706624 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.706799 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.706937 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.707220 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.707362 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.707521 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.707668 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.707805 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.708043 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.708043 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.708310 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.708460 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.708608 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.708745 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.708890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.709034 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.709171 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.709335 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.709472 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.709608 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.709743 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.709885 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.710036 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.710180 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.710316 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.710451 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.710606 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.710743 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.710887 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.711072 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.711211 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.711389 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.711528 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.711691 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.711860 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.712038 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.712137 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.712344 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.712433 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.712648 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.712737 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.712955 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.713043 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.713260 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.713347 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.713555 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.713769 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.713857 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.713945 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.714159 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.714248 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.714460 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.714556 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.714763 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.714858 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.715063 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.715149 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.715359 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.715455 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.715654 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.715741 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.715975 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.716077 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.716284 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.716371 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.716578 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.716671 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.716895 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.716993 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.717273 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.717375 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.717513 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.717600 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.717814 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.717913 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.718111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.718211 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.718423 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.718526 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.718721 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.718821 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.719022 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.719118 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.719317 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.719404 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.719610 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.719697 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.719988 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.720083 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.720295 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.720382 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.720610 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.720700 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.720933 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.721028 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.721242 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.721331 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.721545 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.721633 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.721871 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.721961 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.722197 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.722297 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.722488 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.722576 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.722801 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.722888 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.723101 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.723195 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.723407 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.723495 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.723705 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.723806 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.724036 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.724147 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.724334 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.724416 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.724630 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.724723 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.724928 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.725061 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.725225 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.725321 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.725519 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.725605 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.725814 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.725911 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.726108 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.726194 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.726418 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.726519 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.726734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.726824 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.727037 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.727125 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.727380 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.727490 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.727626 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.727716 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.727945 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.728046 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.728242 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.728349 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.728577 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.728667 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.728876 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.728962 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.729210 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.729310 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.729523 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.729613 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.729841 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.729928 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.730141 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.730240 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.730453 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.730539 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.730761 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.730848 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.731068 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.731163 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.731375 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.731464 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.731680 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.731774 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.732012 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.732180 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.732321 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.732408 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.732626 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.732719 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.732929 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.733025 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.733230 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.733329 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.733536 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.733624 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.733841 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.733939 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.734156 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.734355 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.734672 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.734768 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.734981 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.735077 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.735286 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.735373 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.735612 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.735704 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.735947 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.736040 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.736257 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.736344 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.736560 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.736646 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.736867 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.736956 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.737169 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.737263 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.737484 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.737598 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.737774 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.737870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.738093 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.738182 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.738410 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.738520 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.738728 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.738816 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.739037 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.739126 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.739349 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.739439 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.739657 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.739744 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.739991 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.740080 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.740301 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.740390 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.740640 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.740735 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.740944 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.741042 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.741245 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.741340 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.741553 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.741639 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.741858 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.741953 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.742164 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.742251 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.742466 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.742554 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.742782 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.742889 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.743076 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.743172 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.743378 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.743464 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.743682 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.743771 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.744008 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.744097 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.744318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.744419 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.744621 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.744711 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.744938 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.745025 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.745257 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.745347 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.745568 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.745657 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.745878 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.745965 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.746184 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.746280 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.746494 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.746698 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.747009 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.747097 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.747322 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.747425 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.747646 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.747746 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.747986 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.748086 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.748298 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.748418 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.748608 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.748716 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.748918 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.749002 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.749218 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.749316 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.749519 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.749615 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.749817 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.749904 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.750119 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.750214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.750419 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.750515 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.750717 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.750804 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.751024 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.751112 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.751862 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.751959 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.752165 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.752263 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.752474 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.752565 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.752777 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.753001 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.753302 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.753397 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.753643 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.753740 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.753954 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.754041 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.754273 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.754451 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.754605 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.754705 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.754883 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.754982 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.755179 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.755276 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.755493 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.755587 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.755790 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.755892 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.756113 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.756212 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.756424 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.756512 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.756725 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.756812 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.757022 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.757118 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.757321 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.757415 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.757697 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.757798 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.757924 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.758013 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.758222 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.758316 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.758519 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.758629 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.758815 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.758915 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.759127 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.759216 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.759423 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.759524 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.759723 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.759849 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.760045 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.760132 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.760345 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.760431 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.760640 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.760729 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.760937 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.761024 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.761234 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.761329 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.761533 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.761622 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.761832 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.761917 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.762126 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.762221 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.762424 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.762512 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.762720 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.762811 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.763019 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.763120 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.763315 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.763402 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.763618 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.763704 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.763998 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.764102 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.764299 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.764386 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.764600 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.764800 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.764906 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.764989 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.765193 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.765282 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.765497 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.765584 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.765804 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.765900 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.766106 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.766193 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.766409 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.766496 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.766741 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.766849 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.767658 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.767882 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.768171 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.768261 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.768490 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.768585 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.768891 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.769001 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.769149 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.769254 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.769453 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.769542 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.769756 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.769844 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.770060 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.770157 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.770364 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.770451 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.770676 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.770763 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.770981 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.771081 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.771286 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.771380 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.771590 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.771676 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.771918 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.772024 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.772226 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.772322 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.772532 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.772628 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.772834 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.772923 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.773137 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.773231 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.773438 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.773524 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.773740 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.773831 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.774042 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.774138 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.774344 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.774431 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.774650 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.774740 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.774961 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.775070 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.775286 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.775384 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.775596 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.775683 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.775930 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.776019 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.776242 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.776348 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.776545 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.776633 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.776847 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.776941 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.777149 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.777246 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.777450 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.777537 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.777755 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.777844 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.778067 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.778167 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.778374 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.778469 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.778674 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.778769 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.778974 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.779092 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.779385 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.779498 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.779696 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.779810 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.780036 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.780134 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.780344 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.780442 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.780645 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.780751 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.780963 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.781059 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.781266 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.781369 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.781571 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.781675 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.781908 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.782007 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.782179 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.782282 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.782521 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.782628 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.782848 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.782949 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.783169 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.783265 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.783473 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.783629 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.783769 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.783936 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.784067 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.784194 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.784370 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.784502 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.784672 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.784810 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785019 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785156 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785294 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785422 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785557 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785692 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785847 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.785987 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.786129 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.786257 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.786430 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.786560 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.786725 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.786862 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.787023 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.787153 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.787321 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.787450 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.787617 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.787756 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.787934 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.788080 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.788271 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.788401 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.788540 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.788677 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.788806 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.788941 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.789084 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.789273 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.789405 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.789550 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.789687 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.789815 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.789951 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.790079 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.790215 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.790345 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.790502 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.790634 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.790799 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.790929 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.791097 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.791229 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.791421 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.791553 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.791734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.791908 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.792079 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.792209 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.792385 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.792515 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.792688 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.792825 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.792995 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.793132 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.793296 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.793433 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.793612 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.793755 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.793928 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.794056 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.794233 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.794362 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.794534 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.794672 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.794853 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.794981 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.795160 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.795267 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.795463 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.795570 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.795765 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.795873 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.796092 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.796179 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.796397 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.796493 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.796698 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.796783 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.797016 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.797102 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.797317 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.797404 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.797622 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.797708 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.797938 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.798076 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.798274 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.798359 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.798585 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.798672 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.798892 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.798985 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.799198 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.799293 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.799507 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.799594 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.799813 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.799939 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.800140 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.800227 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.800445 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.800538 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.800747 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.800845 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.801052 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.801146 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.801361 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.801447 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.801668 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.801754 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.801988 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.802081 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.802290 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.802379 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.802597 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.802683 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.802917 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.803004 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.803237 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.803322 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.803548 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.803636 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.803887 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.803987 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.804224 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.804313 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.804534 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.804621 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.804843 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.804929 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.805163 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.805257 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.805387 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:15:00.805475 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:15:00.805669 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:15:00.864453 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO dbcounter [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Registered counter for database nova_api May 27 03:15:00.864596 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Registered counter for database nova_api May 27 03:15:00.884759 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_db.sqlalchemy.engines [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:00.887791 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:00.891257 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writer thread running {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:00.894234 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:00.947743 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.context [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4(cell1) {{(pid=103185) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:15:00.951432 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.context [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4(cell1) {{(pid=103186) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:15:00.952126 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:15:00.953700 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:15:00.954521 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:15:00.955566 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:15:00.956488 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:15:00.957162 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:15:00.957952 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:15:00.958469 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO dbcounter [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Registered counter for database nova_cell0 May 27 03:15:00.959923 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:15:00.961914 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Registered counter for database nova_cell0 May 27 03:15:00.962503 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO dbcounter [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Registered counter for database nova_cell1 May 27 03:15:00.966071 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Registered counter for database nova_cell1 May 27 03:15:00.970880 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_db.sqlalchemy.engines [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:00.972750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_db.sqlalchemy.engines [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:00.974840 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:00.978977 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writer thread running {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:00.979602 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:00.980267 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:00.981160 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writer thread running {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:01.120977 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:01.125429 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO dbcounter [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Registered counter for database nova_cell0 May 27 03:15:01.130446 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Registered counter for database nova_cell0 May 27 03:15:01.134668 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_db.sqlalchemy.engines [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:01.138891 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:15:01.139026 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writer thread running {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:01.143362 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:15:01.471160 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: WARNING keystonemiddleware.auth_token [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:15:01.475045 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:15:01.478219 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: WARNING keystonemiddleware.auth_token [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:15:01.482207 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:15:01.819941 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: WARNING keystonemiddleware.auth_token [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:15:01.825936 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:15:01.826333 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: WARNING keystonemiddleware.auth_token [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:15:01.831288 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8ba4bc9c0 pid: 103185 (default app) May 27 03:15:01.831855 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-6fa6581e-bfed-423e-b41a-74b72111930e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:15:01.833360 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:01.834518 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001708 May 27 03:15:01.834919 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Fri May 27 03:15:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:01.837107 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8ba4bc9c0 pid: 103186 (default app) May 27 03:16:18.372255 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:18.373238 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 27 03:16:18.373630 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:16:18.390309 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_api:SELECT=3 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:18.391387 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_cell0:SELECT=3 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:18.392430 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_cell1:SELECT=3 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:18.393625 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:18.835511 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-433c188d-ff0b-441f-b06c-8e173c7f09a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:18.863628 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-433c188d-ff0b-441f-b06c-8e173c7f09a1 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.483447 May 27 03:16:18.864480 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1291 bytes} [Fri May 27 03:16:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:21.104665 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:21.105664 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-22aac315-e33d-4437-83df-15d8ee03111a None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 27 03:16:21.106236 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:21.165959 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-630274ea-fd98-419f-a186-e6c4125c5ccd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:21.184090 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:16:21.184090 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: warnings.warn(msg) May 27 03:16:21.212928 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-630274ea-fd98-419f-a186-e6c4125c5ccd admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100428 May 27 03:16:21.213666 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:21.227667 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_api:SELECT=3 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:21.229005 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_cell0:SELECT=3 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:21.230037 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_cell1:SELECT=3 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:21.230875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:21.435868 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-32c4453f-b9c6-4adf-9425-e306429aee32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:21.438300 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:16:21.438300 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: warnings.warn(msg) May 27 03:16:21.500865 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-32c4453f-b9c6-4adf-9425-e306429aee32 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279197 May 27 03:16:21.501754 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1335 bytes} [Fri May 27 03:16:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:16:23.769865 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-630274ea-fd98-419f-a186-e6c4125c5ccd admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:23.771445 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-630274ea-fd98-419f-a186-e6c4125c5ccd admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 May 27 03:16:23.772827 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:23.905061 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-420352e7-c5de-4b23-9e06-3cbea7416cf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1"}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:23.923020 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:16:23.923020 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: warnings.warn(msg) May 27 03:16:23.940772 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-420352e7-c5de-4b23-9e06-3cbea7416cf7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162035 May 27 03:16:23.941558 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:23.953732 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-0cb25bff-de63-4c35-a815-044e3bd13aae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:23.955363 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:16:23.955363 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: warnings.warn(msg) May 27 03:16:23.987035 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-0cb25bff-de63-4c35-a815-044e3bd13aae admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037135 May 27 03:16:23.987598 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1335 bytes} [Fri May 27 03:16:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:26.251022 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-420352e7-c5de-4b23-9e06-3cbea7416cf7 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:26.252066 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-420352e7-c5de-4b23-9e06-3cbea7416cf7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 27 03:16:26.252752 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:26.314875 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-a94bdc53-dcc3-411f-98ca-78b7d2cfa595 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:26.337212 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-a94bdc53-dcc3-411f-98ca-78b7d2cfa595 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078508 May 27 03:16:26.343851 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:26.350978 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-b68024d3-9560-4092-9698-a0e1c384b63f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:26.376773 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-b68024d3-9560-4092-9698-a0e1c384b63f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030202 May 27 03:16:26.384720 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1335 bytes} [Fri May 27 03:16:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:28.641709 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-a94bdc53-dcc3-411f-98ca-78b7d2cfa595 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:28.642637 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-a94bdc53-dcc3-411f-98ca-78b7d2cfa595 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 27 03:16:28.643215 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:28.705424 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-d95a9377-5b3f-4def-b11c-6dba2fc02ff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "name": "ds2G"}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:28.724614 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-d95a9377-5b3f-4def-b11c-6dba2fc02ff1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074098 May 27 03:16:28.725743 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:28.737920 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-9efe3e6c-b75a-423e-a01e-d3273774843c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:28.761975 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-9efe3e6c-b75a-423e-a01e-d3273774843c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027741 May 27 03:16:28.763030 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1335 bytes} [Fri May 27 03:16:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:31.083875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-d95a9377-5b3f-4def-b11c-6dba2fc02ff1 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:31.085371 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-d95a9377-5b3f-4def-b11c-6dba2fc02ff1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 May 27 03:16:31.085770 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:16:31.146012 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-99158b00-5484-4af4-a797-76e4e65a3469 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:31.163723 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-99158b00-5484-4af4-a797-76e4e65a3469 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072198 May 27 03:16:31.164411 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:16:31.176656 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-c915a950-5c4b-4d2a-ab72-3398a3810964 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:31.201243 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-c915a950-5c4b-4d2a-ab72-3398a3810964 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028490 May 27 03:16:31.202075 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1335 bytes} [Fri May 27 03:16:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:33.422177 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-99158b00-5484-4af4-a797-76e4e65a3469 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:33.423185 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-99158b00-5484-4af4-a797-76e4e65a3469 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 27 03:16:33.423876 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:33.484206 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-06b6171a-e157-4a20-a1e3-d7e21febde9e admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:33.510056 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-06b6171a-e157-4a20-a1e3-d7e21febde9e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080103 May 27 03:16:33.511880 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1291 bytes} [Fri May 27 03:16:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:16:35.763370 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-99158b00-5484-4af4-a797-76e4e65a3469 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:35.764425 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-99158b00-5484-4af4-a797-76e4e65a3469 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 27 03:16:35.764834 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:35.823007 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-ab35d145-f46e-4aac-9a4a-76d306fcff9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 1, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:35.840829 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-ab35d145-f46e-4aac-9a4a-76d306fcff9b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070127 May 27 03:16:35.841460 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:16:35.853815 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-f8ad3779-f433-47a6-8b88-62e06ee3c625 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:35.876095 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-f8ad3779-f433-47a6-8b88-62e06ee3c625 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026395 May 27 03:16:35.876656 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1332 bytes} [Fri May 27 03:16:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:38.113328 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-ab35d145-f46e-4aac-9a4a-76d306fcff9b admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:38.114738 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-ab35d145-f46e-4aac-9a4a-76d306fcff9b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 May 27 03:16:38.115232 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:38.192486 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-d396fc08-06a1-4a48-8ddb-d2a23990d128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:38.211208 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-d396fc08-06a1-4a48-8ddb-d2a23990d128 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088204 May 27 03:16:38.211757 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:38.224950 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-39562b3c-a13e-4743-ba55-432e421071cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:38.254128 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-39562b3c-a13e-4743-ba55-432e421071cc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033901 May 27 03:16:38.255104 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1332 bytes} [Fri May 27 03:16:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:40.488158 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-d396fc08-06a1-4a48-8ddb-d2a23990d128 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:40.489184 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-d396fc08-06a1-4a48-8ddb-d2a23990d128 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 27 03:16:40.489584 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:40.550121 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-bc0ae7c8-5edf-47ff-8ce1-2dd2c922deca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "ram": 4096}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:40.569457 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-bc0ae7c8-5edf-47ff-8ce1-2dd2c922deca admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073021 May 27 03:16:40.570015 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:40.581782 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-fa6cbc9f-b533-4171-bc93-5e359d89fe87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:40.606077 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-fa6cbc9f-b533-4171-bc93-5e359d89fe87 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027849 May 27 03:16:40.606823 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1332 bytes} [Fri May 27 03:16:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:42.835557 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-bc0ae7c8-5edf-47ff-8ce1-2dd2c922deca admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:42.836704 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-bc0ae7c8-5edf-47ff-8ce1-2dd2c922deca admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002161 May 27 03:16:42.837223 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:42.892618 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-b5dbc62f-7b02-4305-9093-aa68cfcae445 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "vcpus": 4}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:42.911261 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-b5dbc62f-7b02-4305-9093-aa68cfcae445 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068101 May 27 03:16:42.911805 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:16:42.924257 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-fbf5b36a-2c64-4fa9-9779-78360b1062c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:42.953850 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-fbf5b36a-2c64-4fa9-9779-78360b1062c4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033194 May 27 03:16:42.954675 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1332 bytes} [Fri May 27 03:16:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:45.208122 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-b5dbc62f-7b02-4305-9093-aa68cfcae445 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:45.209111 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-b5dbc62f-7b02-4305-9093-aa68cfcae445 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001788 May 27 03:16:45.209515 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:45.271606 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-de6f0c8a-a7a1-4191-8fcc-103690e9f1db admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:45.290462 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-de6f0c8a-a7a1-4191-8fcc-103690e9f1db admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073176 May 27 03:16:45.291314 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1282 bytes} [Fri May 27 03:16:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:16:45.303611 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-1e00073a-2445-4b03-b10a-6caf001d82b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:45.327551 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-1e00073a-2445-4b03-b10a-6caf001d82b5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027606 May 27 03:16:45.332234 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1332 bytes} [Fri May 27 03:16:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:17:09.980587 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-de6f0c8a-a7a1-4191-8fcc-103690e9f1db admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:09.981589 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-de6f0c8a-a7a1-4191-8fcc-103690e9f1db admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 27 03:17:09.981980 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:09.992552 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:10.040462 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-072b0734-999a-45f6-89b1-1c2683e5eb84 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:10.057376 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-072b0734-999a-45f6-89b1-1c2683e5eb84 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069460 May 27 03:17:10.057906 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1291 bytes} [Fri May 27 03:17:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:17:11.039792 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-de6f0c8a-a7a1-4191-8fcc-103690e9f1db admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:11.040810 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-de6f0c8a-a7a1-4191-8fcc-103690e9f1db admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 27 03:17:11.041201 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:17:11.245431 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-24e7707e-6d6c-4110-b409-08a270a4a378 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:11.250959 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.wsgi [None req-24e7707e-6d6c-4110-b409-08a270a4a378 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-24e7707e-6d6c-4110-b409-08a270a4a378 admin admin] Request method failure captured: May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Accept: application/json May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Accept-Encoding: gzip, deflate May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Connection: keep-alive May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Content-Length: 0 May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Host: 10.222.0.62 May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Openstack-Api-Version: compute 2.90 May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Openstack-System-Scope: None May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: User-Agent: python-novaclient May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Auth-Token: gAAAAABikEK3G9ZjtgzhxE1V0iViizlKL0fb9bwXUJT2C8wCtIDCISoQOw7dYq3sioGdEbCNfWIqLwesWILcatBtb_9Cx8ii3f6bIlneGUmjg0MqX15Kc39Dz9gfntocW1p_uhHzOtxKnrhSC7xaC_NfFBax2XSm0KqJjorfmKxvEZmo0sJUyss May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Domain-Id: None May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Domain-Name: None May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Identity-Status: Confirmed May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Is-Admin-Project: True May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Domain-Id: default May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Domain-Name: Default May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Name: admin May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Role: reader,member,admin May 27 03:17:11.254203 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Roles: reader,member,admin May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}] May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant: admin May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant-Name: admin May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User: admin May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Domain-Id: default May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Domain-Name: Default May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Id: 582245e4f2eb472dbbc5854ee9bc3452 May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Name: admin May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: method: > May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: exception: Flavor 42 could not be found. May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: action_args: {'id': '42'} May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:17:11.255870 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:11.257635 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:11.259050 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-24e7707e-6d6c-4110-b409-08a270a4a378 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:17:11.260462 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-24e7707e-6d6c-4110-b409-08a270a4a378 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060816 May 27 03:17:11.260462 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Fri May 27 03:17:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:17:11.265638 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-70ac196f-0538-480c-9e23-b62a6957dbef admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:11.268586 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:11.288653 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-70ac196f-0538-480c-9e23-b62a6957dbef admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026482 May 27 03:17:11.289185 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Fri May 27 03:17:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:17:11.298717 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-c868583a-c5d1-4478-903e-a3ed07f2bbd2 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:11.320152 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-c868583a-c5d1-4478-903e-a3ed07f2bbd2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024426 May 27 03:17:11.320681 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Fri May 27 03:17:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:17:11.330299 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-7967cdc0-7b37-486b-a60d-01fd2566c8a6 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:11.336940 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.wsgi [None req-7967cdc0-7b37-486b-a60d-01fd2566c8a6 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-7967cdc0-7b37-486b-a60d-01fd2566c8a6 admin admin] Request method failure captured: May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Accept: application/json May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Accept-Encoding: gzip, deflate May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Connection: keep-alive May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Content-Length: 0 May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Host: 10.222.0.62 May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Openstack-Api-Version: compute 2.90 May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Openstack-System-Scope: None May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: User-Agent: python-novaclient May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Auth-Token: gAAAAABikEK3G9ZjtgzhxE1V0iViizlKL0fb9bwXUJT2C8wCtIDCISoQOw7dYq3sioGdEbCNfWIqLwesWILcatBtb_9Cx8ii3f6bIlneGUmjg0MqX15Kc39Dz9gfntocW1p_uhHzOtxKnrhSC7xaC_NfFBax2XSm0KqJjorfmKxvEZmo0sJUyss May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Domain-Id: None May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Domain-Name: None May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Identity-Status: Confirmed May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Is-Admin-Project: True May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Domain-Id: default May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Domain-Name: Default May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Name: admin May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Role: reader,member,admin May 27 03:17:11.340163 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Roles: reader,member,admin May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}] May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant: admin May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant-Name: admin May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User: admin May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Domain-Id: default May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Domain-Name: Default May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Id: 582245e4f2eb472dbbc5854ee9bc3452 May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Name: admin May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: method: > May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: exception: Flavor 42 could not be found. May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: action_args: {'id': '42'} May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:17:11.341697 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:11.342679 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:11.343750 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-7967cdc0-7b37-486b-a60d-01fd2566c8a6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:17:11.344808 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-7967cdc0-7b37-486b-a60d-01fd2566c8a6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015292 May 27 03:17:11.344808 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Fri May 27 03:17:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:17:12.194570 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-c868583a-c5d1-4478-903e-a3ed07f2bbd2 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:12.195604 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-c868583a-c5d1-4478-903e-a3ed07f2bbd2 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 27 03:17:12.196044 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:12.383061 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-3e69078f-af82-4a1e-8723-cff0415a2f3a admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:12.388941 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.wsgi [None req-3e69078f-af82-4a1e-8723-cff0415a2f3a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-3e69078f-af82-4a1e-8723-cff0415a2f3a admin admin] Request method failure captured: May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Accept: application/json May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Accept-Encoding: gzip, deflate May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Connection: keep-alive May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Content-Length: 0 May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Host: 10.222.0.62 May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Openstack-Api-Version: compute 2.90 May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Openstack-System-Scope: None May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: User-Agent: python-novaclient May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Auth-Token: gAAAAABikEK4hhez5bXfQtseRoEEFdhrsmV6Dx6vg-swgXeFg2xBJr00L8yjOEWUmxPvJ-VA5-Xo8hjyKquJGknYtT63oKA5CT8gK3Gr-GCEiZIEao26po34Yph5WffnA7GWWv6PI689P6lsA_EMT9qENN8u1INLooUN8c86UrWbqtamUEOAi3M May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Domain-Id: None May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Domain-Name: None May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Identity-Status: Confirmed May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Is-Admin-Project: True May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Domain-Id: default May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Domain-Name: Default May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Name: admin May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Role: reader,member,admin May 27 03:17:12.390492 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Roles: reader,member,admin May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}] May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant: admin May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant-Name: admin May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User: admin May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Domain-Id: default May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Domain-Name: Default May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Id: 582245e4f2eb472dbbc5854ee9bc3452 May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Name: admin May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: method: > May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: exception: Flavor 84 could not be found. May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: action_args: {'id': '84'} May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:17:12.392111 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:12.392989 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:12.394214 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-3e69078f-af82-4a1e-8723-cff0415a2f3a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:17:12.395566 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-3e69078f-af82-4a1e-8723-cff0415a2f3a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059418 May 27 03:17:12.395566 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Fri May 27 03:17:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:17:12.401932 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-e068735e-f5fe-45c8-bef6-8e1808952c82 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:12.417583 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-e068735e-f5fe-45c8-bef6-8e1808952c82 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019677 May 27 03:17:12.418105 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Fri May 27 03:17:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:17:12.427130 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-527ac07e-857b-4088-ba1e-aa2f6899ae34 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:12.440709 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-527ac07e-857b-4088-ba1e-aa2f6899ae34 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016954 May 27 03:17:12.441167 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Fri May 27 03:17:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:17:12.449714 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-9546e859-f018-4f0d-9c0f-a17ec976f780 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:12.454821 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.wsgi [None req-9546e859-f018-4f0d-9c0f-a17ec976f780 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-9546e859-f018-4f0d-9c0f-a17ec976f780 admin admin] Request method failure captured: May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Accept: application/json May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Accept-Encoding: gzip, deflate May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Connection: keep-alive May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Content-Length: 0 May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Host: 10.222.0.62 May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Openstack-Api-Version: compute 2.90 May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Openstack-System-Scope: None May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: User-Agent: python-novaclient May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Auth-Token: gAAAAABikEK4hhez5bXfQtseRoEEFdhrsmV6Dx6vg-swgXeFg2xBJr00L8yjOEWUmxPvJ-VA5-Xo8hjyKquJGknYtT63oKA5CT8gK3Gr-GCEiZIEao26po34Yph5WffnA7GWWv6PI689P6lsA_EMT9qENN8u1INLooUN8c86UrWbqtamUEOAi3M May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Domain-Id: None May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Domain-Name: None May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Identity-Status: Confirmed May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Is-Admin-Project: True May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Domain-Id: default May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Domain-Name: Default May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Name: admin May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Role: reader,member,admin May 27 03:17:12.456327 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Roles: reader,member,admin May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}] May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant: admin May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant-Name: admin May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User: admin May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Domain-Id: default May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Domain-Name: Default May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Id: 582245e4f2eb472dbbc5854ee9bc3452 May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Name: admin May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: method: > May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: exception: Flavor 84 could not be found. May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: action_args: {'id': '84'} May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:17:12.457849 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:12.458957 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:12.460890 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-9546e859-f018-4f0d-9c0f-a17ec976f780 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:17:12.461905 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-9546e859-f018-4f0d-9c0f-a17ec976f780 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011336 May 27 03:17:12.461905 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Fri May 27 03:17:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:17:13.324082 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-527ac07e-857b-4088-ba1e-aa2f6899ae34 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:13.325110 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-527ac07e-857b-4088-ba1e-aa2f6899ae34 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 27 03:17:13.325503 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:13.512600 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-849ddf03-9531-4269-876a-e66ad7b2d3f4 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:13.518248 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.wsgi [None req-849ddf03-9531-4269-876a-e66ad7b2d3f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-849ddf03-9531-4269-876a-e66ad7b2d3f4 admin admin] Request method failure captured: May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Accept: application/json May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Accept-Encoding: gzip, deflate May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Connection: keep-alive May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Content-Length: 0 May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Host: 10.222.0.62 May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Openstack-Api-Version: compute 2.90 May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Openstack-System-Scope: None May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: User-Agent: python-novaclient May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Auth-Token: gAAAAABikEK594ds7K9JmldUUv8ap6YYprdsTzeMnGTgvTf5Tr1G_EnkSIgdLpPy5scmlmitFKdrGZqvxLkLEy1_oYtjl2O72J3K1ZExxJUN2Hss3JaaxYuupbNKX1oIfTTj6Iz86i3JXJhYx-0tEJbuhb5GrMAPY6IdRAbAYhOQ6QsPiyNe15o May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Domain-Id: None May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Domain-Name: None May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Identity-Status: Confirmed May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Is-Admin-Project: True May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Domain-Id: default May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Domain-Name: Default May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Project-Name: admin May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Role: reader,member,admin May 27 03:17:13.519734 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Roles: reader,member,admin May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}] May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant: admin May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-Tenant-Name: admin May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User: admin May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Domain-Id: default May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Domain-Name: Default May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Id: 582245e4f2eb472dbbc5854ee9bc3452 May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: X-User-Name: admin May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: method: > May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: exception: Flavor 451 could not be found. May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: action_args: {'id': '451'} May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:17:13.521318 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:13.522352 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi May 27 03:17:13.523861 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-849ddf03-9531-4269-876a-e66ad7b2d3f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:17:13.525150 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-849ddf03-9531-4269-876a-e66ad7b2d3f4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060344 May 27 03:17:13.525150 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Fri May 27 03:17:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:17:13.530682 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-edf0b5a1-23b4-4af7-aa37-cba38145fa73 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:13.546107 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-edf0b5a1-23b4-4af7-aa37-cba38145fa73 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018865 May 27 03:17:13.546558 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Fri May 27 03:17:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:17:13.556177 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:13.569360 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017289 May 27 03:17:13.569855 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Fri May 27 03:17:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:17:13.578445 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-273454a1-ba73-4737-96d2-459b817be2f9 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:13.583577 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.wsgi [None req-273454a1-ba73-4737-96d2-459b817be2f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-273454a1-ba73-4737-96d2-459b817be2f9 admin admin] Request method failure captured: May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Accept: application/json May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Accept-Encoding: gzip, deflate May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Connection: keep-alive May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Content-Length: 0 May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Host: 10.222.0.62 May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Openstack-Api-Version: compute 2.90 May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Openstack-System-Scope: None May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: User-Agent: python-novaclient May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Auth-Token: gAAAAABikEK594ds7K9JmldUUv8ap6YYprdsTzeMnGTgvTf5Tr1G_EnkSIgdLpPy5scmlmitFKdrGZqvxLkLEy1_oYtjl2O72J3K1ZExxJUN2Hss3JaaxYuupbNKX1oIfTTj6Iz86i3JXJhYx-0tEJbuhb5GrMAPY6IdRAbAYhOQ6QsPiyNe15o May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Domain-Id: None May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Domain-Name: None May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Identity-Status: Confirmed May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Is-Admin-Project: True May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Domain-Id: default May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Domain-Name: Default May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Project-Name: admin May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Role: reader,member,admin May 27 03:17:13.585875 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Roles: reader,member,admin May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d52b88b861a746ccb689f0f6a32f3ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d52b88b861a746ccb689f0f6a32f3ad1"}]}] May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant: admin May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant-Id: d52b88b861a746ccb689f0f6a32f3ad1 May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-Tenant-Name: admin May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User: admin May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Domain-Id: default May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Domain-Name: Default May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Id: 582245e4f2eb472dbbc5854ee9bc3452 May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: X-User-Name: admin May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: method: > May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: exception: Flavor 451 could not be found. May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: action_args: {'id': '451'} May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:17:13.587411 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:13.588562 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: ERROR nova.api.openstack.wsgi May 27 03:17:13.589992 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-273454a1-ba73-4737-96d2-459b817be2f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:17:13.591225 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-273454a1-ba73-4737-96d2-459b817be2f9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012141 May 27 03:17:13.591225 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Fri May 27 03:17:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 27 03:17:14.477533 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:14.479128 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 May 27 03:17:14.479545 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:14.691169 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-532ae707-c951-4fa2-b1f5-82493cfeed15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:17:14.708831 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-532ae707-c951-4fa2-b1f5-82493cfeed15 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067923 May 27 03:17:14.709605 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Fri May 27 03:17:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:17:15.572258 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:15.573257 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 27 03:17:15.573645 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:17:15.760672 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-4f887a0d-b277-44ca-823e-2acad51d3022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:17:15.777646 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-4f887a0d-b277-44ca-823e-2acad51d3022 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068090 May 27 03:17:15.778187 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Fri May 27 03:17:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:17:16.636439 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:16.637436 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 27 03:17:16.637828 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:16.823893 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-9b5f46fc-dc1e-4dc0-a041-aa722abb4b88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:17:16.841897 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-9b5f46fc-dc1e-4dc0-a041-aa722abb4b88 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067467 May 27 03:17:16.842433 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Fri May 27 03:17:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:17:17.703129 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:17.704162 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 27 03:17:17.704552 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:17.893139 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-f2f4eb53-717d-40ee-964f-77ec6958ee3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:17:17.911874 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-f2f4eb53-717d-40ee-964f-77ec6958ee3d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071714 May 27 03:17:17.912466 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Fri May 27 03:17:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:17:18.784093 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:18.785119 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 27 03:17:18.785514 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:18.978308 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-77648016-96ed-4984-b39f-36cf925b989f admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:18.997579 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-77648016-96ed-4984-b39f-36cf925b989f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075070 May 27 03:17:18.998042 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Fri May 27 03:17:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:18:21.363406 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:18:21.364439 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7a7c648f-1e24-4354-b57f-1d37dbf90745 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 27 03:18:21.364825 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 930 bytes} [Fri May 27 03:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:18:21.372677 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.422966 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-58cd5ec6-c744-4341-83af-54cf11a3c5fc admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:18:21.442198 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-58cd5ec6-c744-4341-83af-54cf11a3c5fc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070958 May 27 03:18:21.442731 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1291 bytes} [Fri May 27 03:18:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:18:21.464269 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_api:SELECT=14 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.468339 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-997d5be7-fa0d-495e-8fd2-5b9fac517bd2 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:18:21.476473 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-997d5be7-fa0d-495e-8fd2-5b9fac517bd2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013239 May 27 03:18:21.476988 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1282 bytes} [Fri May 27 03:18:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:18:21.488183 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-648aa789-b2db-4c01-b9ea-5b9656a6d64a admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:18:21.496082 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-648aa789-b2db-4c01-b9ea-5b9656a6d64a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011385 May 27 03:18:21.496595 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1285 bytes} [Fri May 27 03:18:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:18:21.507188 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:18:21.514491 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010721 May 27 03:18:21.514992 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1285 bytes} [Fri May 27 03:18:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:18:21.527309 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-26def220-4033-4ca9-93c4-be8ec4a931c9 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:18:21.534787 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-26def220-4033-4ca9-93c4-be8ec4a931c9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011037 May 27 03:18:21.535286 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1282 bytes} [Fri May 27 03:18:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:21:51.798315 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:51.799947 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 27 03:21:51.800336 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:21:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:21:51.954651 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_api:SELECT=6 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:52.068640 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-39537bfd-cda0-4597-a821-4ed238b76cbd admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:52.069800 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:21:52.069800 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: warnings.warn(msg) May 27 03:21:52.071022 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-39537bfd-cda0-4597-a821-4ed238b76cbd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:52.071461 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-39537bfd-cda0-4597-a821-4ed238b76cbd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:52.072276 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-39537bfd-cda0-4597-a821-4ed238b76cbd admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:52.072699 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-39537bfd-cda0-4597-a821-4ed238b76cbd admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:52.106565 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-39537bfd-cda0-4597-a821-4ed238b76cbd admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153302 May 27 03:21:52.107108 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Fri May 27 03:21:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:21:52.973976 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:52.974972 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 27 03:21:52.975365 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:21:53.168000 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-719d76b8-bb3f-426b-af76-22992be09ab2 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:53.169176 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:21:53.169176 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: warnings.warn(msg) May 27 03:21:53.170352 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-719d76b8-bb3f-426b-af76-22992be09ab2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:53.170791 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-719d76b8-bb3f-426b-af76-22992be09ab2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:53.171607 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-719d76b8-bb3f-426b-af76-22992be09ab2 admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:53.172193 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-719d76b8-bb3f-426b-af76-22992be09ab2 admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:53.192015 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-719d76b8-bb3f-426b-af76-22992be09ab2 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075862 May 27 03:21:53.192478 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Fri May 27 03:21:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:22:04.487510 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:22:04.488549 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 27 03:22:04.488945 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:22:04.629704 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_cell0:SELECT=4 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:04.630413 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_cell1:SELECT=4 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:04.631016 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG dbcounter [-] [103185] Writing DB stats nova_api:SELECT=8 {{(pid=103185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:04.679092 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-c5877785-9e72-4452-8a9e-b693dbebe9d0 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:22:04.680305 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:22:04.680305 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: warnings.warn(msg) May 27 03:22:04.681472 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-c5877785-9e72-4452-8a9e-b693dbebe9d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:04.681907 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-c5877785-9e72-4452-8a9e-b693dbebe9d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:04.682713 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-c5877785-9e72-4452-8a9e-b693dbebe9d0 admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:04.683138 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-c5877785-9e72-4452-8a9e-b693dbebe9d0 admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:04.708057 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-c5877785-9e72-4452-8a9e-b693dbebe9d0 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082752 May 27 03:22:04.708530 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Fri May 27 03:22:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:22:05.575967 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:22:05.576964 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-eb34c3f5-a1d7-4880-a1eb-075d6c94ab56 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 27 03:22:05.577358 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Fri May 27 03:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:22:05.763711 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG nova.api.openstack.wsgi [None req-84b3c4a8-7763-431c-a3d2-9af0ec3f6555 admin admin] Calling method '>' {{(pid=103185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:22:05.764915 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:22:05.764915 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: warnings.warn(msg) May 27 03:22:05.766102 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-84b3c4a8-7763-431c-a3d2-9af0ec3f6555 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:05.766540 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-84b3c4a8-7763-431c-a3d2-9af0ec3f6555 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:05.767388 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-84b3c4a8-7763-431c-a3d2-9af0ec3f6555 admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:05.768011 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: DEBUG oslo_concurrency.lockutils [None req-84b3c4a8-7763-431c-a3d2-9af0ec3f6555 admin admin] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:05.790136 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: INFO nova.api.openstack.requestlog [None req-84b3c4a8-7763-431c-a3d2-9af0ec3f6555 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076733 May 27 03:22:05.790690 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: [pid: 103185|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Fri May 27 03:22:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:02.287783 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: Fri May 27 03:23:02 2022 - graceful shutdown triggered... May 27 03:23:02.287520 dv-cinder-828807-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 03:23:02.288816 dv-cinder-828807-4-iscsi devstack@n-api.service[103185]: Gracefully killing worker 1 (pid: 103185)... May 27 03:23:02.289210 dv-cinder-828807-4-iscsi devstack@n-api.service[103186]: Gracefully killing worker 2 (pid: 103186)... May 27 03:23:03.288780 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: worker 1 buried after 1 seconds May 27 03:23:03.288780 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: worker 2 buried after 1 seconds May 27 03:23:03.288780 dv-cinder-828807-4-iscsi devstack@n-api.service[103184]: goodbye to uWSGI. May 27 03:23:03.290167 dv-cinder-828807-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 03:23:03.290767 dv-cinder-828807-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 03:23:03.293452 dv-cinder-828807-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:23:03.308309 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:23:03 2022] *** May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: nodename: dv-cinder-828807-4-iscsi May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: machine: x86_64 May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: clock source: unix May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: pcre jit disabled May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: detected number of CPU cores: 4 May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: current working directory: / May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: detected binary path: /usr/bin/uwsgi-core May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: your processes number limit is 47680 May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: your memory page size is 4096 bytes May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: detected max file descriptor number: 2048 May 27 03:23:03.324960 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: lock engine: pthread robust mutexes May 27 03:23:03.326184 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: thunder lock: enabled May 27 03:23:03.326184 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:23:03.326184 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:23:03.370000 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: Python main interpreter initialized at 0x55d9371f19c0 May 27 03:23:03.370000 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: python threads support enabled May 27 03:23:03.370000 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: your server socket listen backlog is limited to 100 connections May 27 03:23:03.370000 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: your mercy for graceful operations on workers is 90 seconds May 27 03:23:03.370409 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:23:03.370409 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: *** Operational MODE: preforking *** May 27 03:23:03.370679 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: *** uWSGI is running in multiple interpreter mode *** May 27 03:23:03.370679 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: spawned uWSGI master process (pid: 117594) May 27 03:23:03.370880 dv-cinder-828807-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:23:03.371771 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: spawned uWSGI worker 1 (pid: 117609, cores: 1) May 27 03:23:03.371771 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: spawned uWSGI worker 2 (pid: 117610, cores: 1) May 27 03:23:03.371993 dv-cinder-828807-4-iscsi devstack@n-api.service[117594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:23:04.544883 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:23:04.545602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:23:05.340933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:23:05.340933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: from cryptography.utils import int_from_bytes May 27 03:23:05.341303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:23:05.341303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: from cryptography.utils import int_from_bytes May 27 03:23:05.341764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:23:05.341764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: from cryptography.utils import int_from_bytes May 27 03:23:05.342104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:23:05.342104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: from cryptography.utils import int_from_bytes May 27 03:23:07.748836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:23:07.749396 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:23:07.749628 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:23:07.749987 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:23:07.750237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:23:07.750665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.750941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.751256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.751571 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.751931 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.752240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.752555 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.752873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.753196 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.753455 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.753769 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.754089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-4-iscsi {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.754185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:23:07.754566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:23:07.754663 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.754767 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.754862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:23:07.754988 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.755201 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:23:07.755295 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.755458 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:23:07.755585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.755863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.755971 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.756195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.756300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.756516 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.756694 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.757116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.757220 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.757302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.757426 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.757535 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.757730 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.757906 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.758123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.758227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.758364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.758467 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.758625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.758733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.758941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.759040 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.759266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-4-iscsi {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.759417 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.759582 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.759730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.759912 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.760062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.760227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.760354 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-4-iscsi {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.760564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.760667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.760870 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.761047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.761200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.761352 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.761497 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.761644 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.761873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.761983 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.762178 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.762278 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.762496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.762590 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.762819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.762919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.763123 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.763227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.763444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.763582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.763750 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.763874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.764091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.764197 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.764399 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.764498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.764696 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.764798 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.764999 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.765092 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.765326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.765434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-4-iscsi {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.765640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.765744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.765938 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.766032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.766237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.766343 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.766485 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.766702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.766852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.767015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.767127 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.767326 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.767428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.767648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.767765 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.767958 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.768072 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.768223 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.768366 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.768508 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.768650 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.768866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.769013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.769119 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.769206 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.769400 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.769503 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.769702 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.769804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.770014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.770159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.770304 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.770406 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.770603 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.770705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.770900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.771039 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.771199 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.771306 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.771502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.771664 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.772066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.772196 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.772196 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.772443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.772443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.772637 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.772766 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.773019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.773125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.773269 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.773586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.773906 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.774081 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.774211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.774331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.774505 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.774795 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.774913 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.775099 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.775401 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.775571 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.775782 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.775909 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.776186 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.776438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.776548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.776772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.776875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.777098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.777205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.777407 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.777514 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.777717 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.777846 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.778026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.778144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.778346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.778475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.778671 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.778777 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.778977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.779131 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.779231 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.779347 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.779515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.779611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.779875 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.780033 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.780142 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.780286 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.780444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.780547 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.780747 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.781377 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.781610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.781756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.781895 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.782027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.782202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.782346 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.782475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.782572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.782776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.782918 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.783072 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.783164 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.783373 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.783477 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.783671 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.783764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.784003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.784167 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.784321 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.784473 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.784622 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.784775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.784925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.785089 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.785242 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.785390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.785538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.785690 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.785841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.785995 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786625 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786726 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786814 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.786992 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.787202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.787299 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.787513 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.787607 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.787812 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.787970 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.788136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.788251 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.788450 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.788554 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.788753 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.788846 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.789056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.789156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.789361 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.789463 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.789655 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.789748 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.789958 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.790052 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.790265 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.790369 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.790563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.790657 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.790865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.790969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.791165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.791266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.791464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.791557 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.791763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.791918 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.792087 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.792235 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.792386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.792479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.792683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.792778 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.792979 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.793073 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.793285 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.793386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.793597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.793692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.793902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.794010 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.794201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.794338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.794500 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.794604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.794802 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.794902 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.795106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.795201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.795413 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.795525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.795716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.795808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.796045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.796140 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.796346 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.796454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.797220 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.797327 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.797542 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.797690 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.797852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.798144 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.798251 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.798350 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.798446 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.798540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.798754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:23:07.798857 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.799066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.799160 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.799381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.799476 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.799696 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.799801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.800033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.800138 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.800362 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.800466 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.800675 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.800770 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.800988 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.801080 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.801301 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.801408 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.801606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.801698 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.801919 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.802027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.802229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.802363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.802540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.802649 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.802845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.802944 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.803160 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.803254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.803477 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.803580 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.803806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.803953 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.804142 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.804237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.804457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.804552 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.804763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.804863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.805070 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.805163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.805377 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.805472 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.805696 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.805797 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.806014 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.806107 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.806323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.806415 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.806638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.806732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.806949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.807051 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.807258 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.807394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.807564 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.807660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.807893 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.808010 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.808204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.808301 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.808536 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.808632 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.808843 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.808944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.809153 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.809252 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.809462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.809563 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.809775 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.809888 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.810083 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.810184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.810390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.810492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.810698 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.810839 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.810998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.811092 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.811298 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.811389 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.811597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.811692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.811925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.812023 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.812251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.812357 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.812569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.812675 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.812889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.812982 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.813191 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.813291 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.813503 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.813603 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.813812 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.813907 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.814119 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.814218 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.814440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.814543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.814724 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.814827 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.815025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.815134 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.815335 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.815436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.815638 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.815731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.815984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.816093 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.816315 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.816418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.816623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.816724 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.816925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.817027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.817244 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.817346 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.817544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.817644 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.817843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.817945 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.818149 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.818249 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.818453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.818549 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.818758 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.818853 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.819130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.819256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.819360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.819449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.819661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.819763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.819991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.820087 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.820295 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.820399 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.820624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.820734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.820926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.821025 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.821231 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.821334 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.821544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.821638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.821855 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.821956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.822216 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.822340 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.822460 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.822600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.822766 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.822859 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.823063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.823164 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.823361 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.823455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.823665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.823758 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.823996 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.824172 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.824297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.824401 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.824596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.824690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.824896 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.824994 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.825194 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.825289 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.825491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.825593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.825808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.825904 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.826142 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.826242 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.826447 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.826548 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.826750 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.826852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.827055 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.827150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.827362 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.827463 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.827684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.827780 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.828025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.828121 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.828331 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.828475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.828636 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.828739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829188 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829414 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829542 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829644 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829848 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.829943 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.830150 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.830258 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.830453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.830556 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.830759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.830860 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.831074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.831176 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.831381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.831482 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.831696 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.831789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.832026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.832136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.832345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.832453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.832651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.832744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.832965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.833068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.833263 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.833354 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.833825 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.833923 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.834136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.834242 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.834448 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.834542 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.834764 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.834871 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.835073 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.835170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.835376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.835468 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.835685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.835786 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.836013 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.836110 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.836318 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.836413 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.836621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.836724 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.836926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.837026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.837236 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.837329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.837540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.837651 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.837857 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.837997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.838162 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.838279 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.838478 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.838603 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.838782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.838884 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.839093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.839184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.839389 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.839490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.839697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.839788 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.840032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.840129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.840352 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.840478 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.840654 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.840759 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.840960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.841064 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.841275 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.841383 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.841578 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.841678 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.841882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.841975 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.842191 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.842296 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.842489 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.842593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.842789 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.842890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.843095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.843191 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.843937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.844053 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.844245 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.844348 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.844549 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.844652 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.844848 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.844949 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.845156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.845270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.845460 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.845569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.845758 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.845852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.846060 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.846164 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.846364 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.846457 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.846670 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.846772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.846976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.847081 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.847289 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.847381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.847599 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.847701 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.847920 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.848030 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.848223 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.848317 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.848534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.848664 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.848836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.848931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.849136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.849229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.849436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.849529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.849743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.849885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.850056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.850157 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.850363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.850455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.850662 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.850779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.850972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.851079 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.851282 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.851370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.851583 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.851676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.851909 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.852021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.852216 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.852320 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.852520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.852664 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.852825 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.852919 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.853126 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.853300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.853428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.853529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.853737 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.853829 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.854040 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.854154 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.854344 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.854447 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.854648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.854751 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.854957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.855059 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.855258 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.855357 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.855563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.855671 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.855886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.855985 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.856188 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.856293 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.856495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.856588 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.856800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.856893 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.857110 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.857365 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.857465 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.857695 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.857797 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.858006 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.858108 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.858319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.858412 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.858623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.858763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.858950 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.859608 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.859775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.859892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.860105 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.860203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.860422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.860523 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.860736 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.860844 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.861046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.861308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.861454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.861643 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.861768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.861951 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.862047 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.862256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.862358 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.862559 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.862654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.862861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.862953 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.863168 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.863262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.863469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.863564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.863775 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.863919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.864102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.864207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.864404 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.864507 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.864716 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.864819 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.865019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.865114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.865326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.865478 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.865627 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.865730 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.865932 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.866026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.866236 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.866336 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.866537 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.866639 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.866839 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.866932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.867135 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.867237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.867435 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.867540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.867737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.867857 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.868077 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.868182 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.868383 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.868486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.868691 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.868806 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.868998 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.869110 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.869315 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.869410 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.869624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.869724 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.869926 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.870017 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.870225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.870320 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.870524 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.870625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.870830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.870931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.871138 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.871260 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.871437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.871552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.871744 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.871886 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.872068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.872163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.872376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.872546 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.872702 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.872865 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.872958 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.873045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.873255 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.873409 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.873597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.873752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.873897 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.874042 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.874182 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.874323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.874474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.875129 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.875297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.875441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.875582 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.875684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.875902 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.876013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.876202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.876297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.876506 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.876600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.876807 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.876902 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.877115 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.877218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.877412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.877506 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.877712 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.877815 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.878011 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.878107 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.878310 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.878414 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.878610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.878715 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.878906 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.879009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.879211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.879314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.879513 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.879615 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.879809 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.879943 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.880130 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.880234 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.880433 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.880534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.880731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.880832 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.881031 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.881137 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.881333 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.881448 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.881635 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.881750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.881996 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.882107 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.882253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.882349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.882531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.882631 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.882833 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.882977 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.883132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.883282 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.883435 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.883538 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.883735 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.883866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.884060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.884155 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.884358 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.884458 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.884658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.884754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.884956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.885057 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.885256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.885352 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.885567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.885668 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.885866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.885963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.886166 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.886268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.886464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.886565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.886761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.886857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.887063 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.887165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.887364 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.887466 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.887667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.887760 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.887995 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.888105 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.888298 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.888393 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.888600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.888700 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.888922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.889027 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.889225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.889318 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.889526 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.889621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.889825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.889952 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.890119 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.890256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.890962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.891070 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.891272 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.891383 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.891575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.891683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.891894 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.892008 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.892219 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.892335 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.892521 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.892657 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.892826 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.892958 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.893142 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.893240 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.893459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.893563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.893764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.893870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.894063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.894163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.894366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.894460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.894669 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.894778 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.894972 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.895073 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.895273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.895367 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.895576 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.895685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.895902 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.896012 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.896210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.896310 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.896513 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.896615 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.896819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.896923 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.897124 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.897225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.897424 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.897520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.897726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.897819 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.898027 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.898121 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.898326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.898457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.898631 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.898733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.898934 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.899028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.899231 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.899327 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.899534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.899635 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.899846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.899946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.900154 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.900251 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.900451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.900555 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.900751 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.900854 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.901060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.901161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.901364 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.901465 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.901668 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.901794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.901988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.902090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.902300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.902427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.902601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.902735 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.902906 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.903030 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.903212 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.903333 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.903520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.903633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.903850 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.903957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.904241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.904338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.904546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.904642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.904845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.904939 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.905143 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.905247 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.905448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.905544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.905754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.905877 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.906096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.906282 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.906393 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.906591 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.906685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.906893 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.907100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.907203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.907409 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.907512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.907721 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.907867 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.908055 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.908225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.908359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.908534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.908662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.908836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.908970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.909245 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.909349 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.909550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.909653 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.909855 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.909949 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.910155 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.910256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.910475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.910577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.910777 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.910886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.911077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.911181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.911387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.911480 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.911710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.911886 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.912097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.912217 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.912422 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.912632 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.912743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.912941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.913062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.913324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.913434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.913569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.913717 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.913930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.914197 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.914294 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.914527 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.914632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.914836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.914932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.915157 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.915265 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.915473 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.915588 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919369 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919535 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919626 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919626 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919767 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919889 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.919980 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920369 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920521 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920666 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.920922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.921014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.921097 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.921171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.921243 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.921321 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.921395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.921990 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922074 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922148 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922489 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922646 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922729 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922888 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.922961 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923260 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923342 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923586 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.923848 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.924126 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.924621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.924771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.924930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.925075 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.925221 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.925374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.925518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.925671 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.925822 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.925972 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926303 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926541 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926627 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926813 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.926909 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.927006 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.927101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.927187 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.927358 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.927487 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.927662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.927792 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.928032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.928128 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.928338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.928434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.928657 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.928844 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.928984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.929087 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.929290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.929393 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.929589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.929691 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.930205 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.930341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.930468 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.930591 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.930704 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.930816 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.930967 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.931081 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.931203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.931326 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.931446 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.931568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.931681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.931807 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.932027 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.932220 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.932347 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.932461 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.932593 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.932879 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.933020 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.933204 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.933332 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.933446 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.933743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.933946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934186 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934301 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934541 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934669 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.934901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.935014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.935133 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.935792 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.935921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936115 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936626 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936714 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936811 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.936908 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.937153 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.937789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.937963 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.938108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.938273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.938433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.938585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.938762 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.939076 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.939180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.939399 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.939503 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.939717 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.939841 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.940060 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.940163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.940370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.940466 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.940679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.940779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.940990 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.941091 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.941299 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.941402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.941605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.941700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.941912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.942007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.942223 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.942381 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.942527 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.942656 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.942847 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.942949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.943167 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.943384 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.943497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.943713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.943875 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.944056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.944169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.944369 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.944471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.944682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.944776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.944996 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.945098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.945312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.945405 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.945629 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.945722 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.945938 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.946028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.946246 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.946349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.946559 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.946728 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.946866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.946973 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.947173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.947271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.947484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.947592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.947791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.947919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.948154 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.948250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.948462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.948559 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.948771 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.948866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.949082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.949224 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.949400 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.949496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.949730 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.949833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.950046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.950160 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.950356 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.950460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.950663 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.950765 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.950975 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.951079 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.951309 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.951486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.951621 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.951796 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.951957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.952145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.952249 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.952469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.952576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.953353 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.953473 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.953673 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.953795 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.953989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.954111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.954307 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.954414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.954609 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.954715 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.954910 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.955007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.955215 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.955323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.955518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.955614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.955835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.955946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.956151 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.956387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.956494 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.956705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.956796 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.957040 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.957144 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.957340 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.957503 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.957679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.957869 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.957997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.958215 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.958311 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.958783 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.958885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.959114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.959241 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.959464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.959566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.959743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.959872 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.960072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.960169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.960388 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.960482 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.960689 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.960780 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.960993 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.961101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.961295 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.961387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.961601 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.961692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.961903 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.962005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.962203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.962434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.962531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.962782 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.962882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.963087 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.963180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.963424 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.963533 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.963694 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.963834 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.964040 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.964156 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.964346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.964452 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.964645 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.964754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.964945 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.965048 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.965259 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.965413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.965575 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.965724 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.965892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.966030 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.966197 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.966335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.966503 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.966638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.966822 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.966946 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.967122 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.967246 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.967426 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.967553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.967736 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.967874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.968063 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.968183 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.968921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.969053 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.969237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.969412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.969566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.969721 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.969893 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.970045 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.970190 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.970336 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.970487 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.970638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.970794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.970938 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.971034 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.971224 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.971375 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.971525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.971677 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.971861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.972014 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.972173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.972316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.972469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.972591 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.972753 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.972849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.973097 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.973233 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.973422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.973596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.973756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.973881 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.974079 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.974235 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.974384 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.974525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.974689 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.974830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.975002 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.975133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.975310 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.975437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.975631 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.975759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.976037 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.976150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.976351 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.976444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.976699 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.976791 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.977008 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.977116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.977314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.977539 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.977632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.977872 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.977964 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.978191 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.978285 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.978496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.978588 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.978803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.978907 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.979109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.979210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.979415 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.979529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.979717 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.979846 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.980055 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.980148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.980373 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.980467 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.980685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.980792 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.980996 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.981090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.981307 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.981406 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.981613 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.981707 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.981918 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.982019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.982225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.982346 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.982529 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.982630 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.982836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.982936 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.983145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.983244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.983454 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.983570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.983845 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.983942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.984107 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.984212 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.984426 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.984519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.984768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.984873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.985084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.985188 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.985400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.985495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.985718 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.985817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.986032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.986206 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.986341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.986435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.986645 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.986752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.986951 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.987086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.987719 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.987885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.987885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988258 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988343 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988828 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.988923 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.989128 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.989224 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.989439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.989531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.989732 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.989828 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.990045 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.990148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.990349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.990451 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.990649 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.990756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.990948 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.991049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.991254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.991356 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.991554 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.991647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.991871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.991970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.992176 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.992281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.992504 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.992605 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.992779 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.992902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.993076 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.993206 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.993373 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.993510 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.993676 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.993946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.994069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.994158 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.994252 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.994425 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.994537 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.994735 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.994852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.995044 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.995146 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.995340 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.995442 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.995653 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.995759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.995981 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.996089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.996280 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.996372 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.996582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.996683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.996891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.996983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.997192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.997326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.997495 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.997590 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.997799 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.997908 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.998100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.998194 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.998400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.998502 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.998703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.998797 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.999005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.999106 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.999311 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.999413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.999636 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.999739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:07.999964 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.000079 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.000266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.000360 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.000569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.000662 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.000919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.001035 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.001173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.001266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.001478 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.001572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.001782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.001886 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.002105 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.002199 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.002416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.002508 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.002717 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.002820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.003031 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.003139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.003345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.003464 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.003667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.003783 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.004083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.004197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.004464 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.004601 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.004715 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.004804 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.004922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.005042 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.005231 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.005336 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.005538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.005642 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.005845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.005938 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.006149 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.006256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.006457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.006552 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.006769 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.006860 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.007092 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.007197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.007397 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.007492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.007707 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.007807 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.008057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.008176 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.008373 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.008474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.008690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.008790 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.009000 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.009096 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.009329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.009435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.009640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.009737 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.009950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.010044 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.010260 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.010354 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.010560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.010661 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.010803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:23:08.010905 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.011170 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.011488 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.011868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.012166 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.012479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.012807 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.013135 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.013482 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.013798 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.014143 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.014473 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.014788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.015098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.015941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:23:08.016189 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:23:08.070383 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO dbcounter [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Registered counter for database nova_api May 27 03:23:08.075281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO dbcounter [None req-a4319927-dc98-405e-a179-620967efe09e None None] Registered counter for database nova_api May 27 03:23:08.091692 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_db.sqlalchemy.engines [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.097106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_db.sqlalchemy.engines [None req-a4319927-dc98-405e-a179-620967efe09e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.100416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writer thread running {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.104668 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writer thread running {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.158589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.context [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4(cell1) {{(pid=117610) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:23:08.161981 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.context [None req-a4319927-dc98-405e-a179-620967efe09e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4(cell1) {{(pid=117609) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:23:08.163147 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:08.165047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:08.165904 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:08.167331 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4319927-dc98-405e-a179-620967efe09e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:08.168121 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:08.169077 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4319927-dc98-405e-a179-620967efe09e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:08.170100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4319927-dc98-405e-a179-620967efe09e None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:08.171275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO dbcounter [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Registered counter for database nova_cell0 May 27 03:23:08.172670 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4319927-dc98-405e-a179-620967efe09e None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:08.175019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO dbcounter [None req-a4319927-dc98-405e-a179-620967efe09e None None] Registered counter for database nova_cell0 May 27 03:23:08.176841 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO dbcounter [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Registered counter for database nova_cell1 May 27 03:23:08.178946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO dbcounter [None req-a4319927-dc98-405e-a179-620967efe09e None None] Registered counter for database nova_cell1 May 27 03:23:08.185162 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_db.sqlalchemy.engines [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.188558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_db.sqlalchemy.engines [None req-a4319927-dc98-405e-a179-620967efe09e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.189339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_db.sqlalchemy.engines [None req-a4319927-dc98-405e-a179-620967efe09e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.193166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_db.sqlalchemy.engines [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.196124 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writer thread running {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.199764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writer thread running {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.344543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writer thread running {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.348318 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writer thread running {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.355029 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO dbcounter [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Registered counter for database nova_cell0 May 27 03:23:08.357824 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO dbcounter [None req-a4319927-dc98-405e-a179-620967efe09e None None] Registered counter for database nova_cell0 May 27 03:23:08.362270 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_db.sqlalchemy.engines [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.367393 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writer thread running {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.369127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_db.sqlalchemy.engines [None req-a4319927-dc98-405e-a179-620967efe09e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:23:08.375778 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writer thread running {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:23:08.693867 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: WARNING keystonemiddleware.auth_token [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:23:08.700982 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: WARNING keystonemiddleware.auth_token [None req-a4319927-dc98-405e-a179-620967efe09e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:23:08.701159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: WARNING keystonemiddleware.auth_token [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:23:08.708834 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: WARNING keystonemiddleware.auth_token [None req-a4319927-dc98-405e-a179-620967efe09e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:23:09.050912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: WARNING keystonemiddleware.auth_token [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:23:09.051452 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: WARNING keystonemiddleware.auth_token [None req-a4319927-dc98-405e-a179-620967efe09e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:23:09.056826 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: WARNING keystonemiddleware.auth_token [None req-a59c238a-c035-41f4-87bf-312a0c5b958f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:23:09.056944 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: WARNING keystonemiddleware.auth_token [None req-a4319927-dc98-405e-a179-620967efe09e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:23:09.062178 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9371f19c0 pid: 117609 (default app) May 27 03:23:09.062308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9371f19c0 pid: 117610 (default app) May 27 03:23:50.106374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:50.110441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:50.111291 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:50.112436 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:50.193737 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:50.195766 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:50.197129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:50.198254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:51.361992 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-714c3b8b-6f04-4866-82c0-f41616ca8886 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Action: 'create', calling method: .version_select at 0x7f40c2c7bd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1181548", "metadata": {"Type": "work"}}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:51.781225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0ccb7537-de0c-4377-bed5-099a56d2ff9a tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Action: 'create', calling method: .version_select at 0x7f40c2c7cc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-282876024"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:52.981641 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0ccb7537-de0c-4377-bed5-099a56d2ff9a tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.804886 May 27 03:23:52.989201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1154 bytes} [Fri May 27 03:23:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2814 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 27 03:23:52.996308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0c76e7a1-8087-4ef4-9e83-f351a7f47cff tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ac9c10>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:53.129699 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0c76e7a1-8087-4ef4-9e83-f351a7f47cff tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641" status: 200 len: 344 microversion: 2.1 time: 0.138702 May 27 03:23:53.130550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 2/2] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:52 2022] GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:53.204648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-49798907-acbd-46d6-81b5-436a352276dd tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2ac9dc0>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:53.335103 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-714c3b8b-6f04-4866-82c0-f41616ca8886 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 350 microversion: 2.1 time: 3.243809 May 27 03:23:53.336094 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1155 bytes} [Fri May 27 03:23:50 2022] POST /compute/v2.1/os-volumes => generated 350 bytes in 3246 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 03:23:53.348927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-96ee61c3-6832-4897-b487-25fb5538ba47 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2acfca0>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:53.359402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-49798907-acbd-46d6-81b5-436a352276dd tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/8f525b6b-8bdb-402c-97cd-0ed7a04fee37" status: 200 len: 351 microversion: 2.1 time: 0.158560 May 27 03:23:53.360384 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:53 2022] GET /compute/v2.1/os-volumes/8f525b6b-8bdb-402c-97cd-0ed7a04fee37 => generated 351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:53.460466 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-96ee61c3-6832-4897-b487-25fb5538ba47 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 200 len: 350 microversion: 2.1 time: 0.115677 May 27 03:23:53.467056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 2/5] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:53 2022] GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:54.143143 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-818eab7b-4b8d-4924-97d7-3e842eb2fd49 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae0430>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.232017 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-818eab7b-4b8d-4924-97d7-3e842eb2fd49 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641" status: 200 len: 345 microversion: 2.1 time: 0.092551 May 27 03:23:54.232571 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 4/6] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.245207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1e55fe89-b628-4268-88cc-fa9983b21506 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Action: 'create', calling method: .version_select at 0x7f40c2acfe50>, body: {"snapshot": {"volume_id": "981c2c28-9bd6-4840-a3c6-c3d7b1169641", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1249697561"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:54.478551 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-57586d05-2f8f-4b6c-9d73-108305a97f51 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2ae0af0>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.570134 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-57586d05-2f8f-4b6c-9d73-108305a97f51 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 200 len: 351 microversion: 2.1 time: 0.099131 May 27 03:23:54.571386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 5/7] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.586730 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6f5fb378-6240-47f7-9d70-62e307d13aba tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2ae0b80>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.612463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1e55fe89-b628-4268-88cc-fa9983b21506 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.372577 May 27 03:23:54.619311 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 3/8] 10.222.0.62 () {60 vars in 1161 bytes} [Fri May 27 03:23:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.634003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4076112f-521b-4ec6-95ef-e49b178e14bf tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae4940>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.702086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4076112f-521b-4ec6-95ef-e49b178e14bf tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 200 len: 287 microversion: 2.1 time: 0.075909 May 27 03:23:54.702965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 4/9] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.711717 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6f5fb378-6240-47f7-9d70-62e307d13aba tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 200 len: 351 microversion: 2.1 time: 0.133122 May 27 03:23:54.722674 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 6/10] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.723027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-12303aee-68e8-4ce3-80f7-c6e9da0aa0ac tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae9040>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.733013 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e24a6d3c-1c30-4940-89a9-0447b5c4ee28 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2ae0430>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.830559 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-12303aee-68e8-4ce3-80f7-c6e9da0aa0ac tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121533 May 27 03:23:54.831361 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 5/11] 10.222.0.62 () {58 vars in 1139 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.840064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e24a6d3c-1c30-4940-89a9-0447b5c4ee28 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 202 len: 0 microversion: 2.1 time: 0.113785 May 27 03:23:54.843513 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-92046935-2938-4c6d-a439-dbc4d9f9be7c tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae4c10>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.844781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 7/12] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:23:54 2022] DELETE /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:23:54.850401 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9b3fe548-6232-4bec-a30a-e65f40cd6f03 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2ac9af0>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.906278 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-92046935-2938-4c6d-a439-dbc4d9f9be7c tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 200 len: 287 microversion: 2.1 time: 0.067267 May 27 03:23:54.906945 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 6/13] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.978088 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c1fc5070-4ed9-4bf6-a5fc-7087d3720541 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2ae44c0>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.996107 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9b3fe548-6232-4bec-a30a-e65f40cd6f03 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 200 len: 350 microversion: 2.1 time: 0.148449 May 27 03:23:54.997607 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 8/14] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:55.093128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c1fc5070-4ed9-4bf6-a5fc-7087d3720541 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/43478d5e-80b4-4131-b488-d37ac03bad70" status: 200 len: 350 microversion: 2.1 time: 0.118723 May 27 03:23:55.093866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 7/15] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/os-volumes/43478d5e-80b4-4131-b488-d37ac03bad70 => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:55.770077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1881632087", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "networks": [{"uuid": "2a4005f4-c23a-4d5e-b276-9219ecc15e3e"}]}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:55.928191 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-767066b9-f067-4693-85bf-ebae1d2826f8 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2acfa60>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:55.992358 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] validate_networks() for [('2a4005f4-c23a-4d5e-b276-9219ecc15e3e', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:23:56.051964 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-767066b9-f067-4693-85bf-ebae1d2826f8 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 200 len: 287 microversion: 2.1 time: 0.133852 May 27 03:23:56.052591 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:23:55 2022] GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:56.062468 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a3bd35d8-673f-4abf-8070-e4737c31fb6d tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2acfc10>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:56.170686 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a3bd35d8-673f-4abf-8070-e4737c31fb6d tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 200 len: 350 microversion: 2.1 time: 0.113204 May 27 03:23:56.171522 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 9/17] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:56 2022] GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:57.067927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d37920cc-ffb1-425c-bc9d-f5eeca1064a2 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae44c0>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:57.115210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d37920cc-ffb1-425c-bc9d-f5eeca1064a2 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 200 len: 287 microversion: 2.1 time: 0.054228 May 27 03:23:57.116471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 10/18] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:23:57 2022] GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:57.183202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f6b88c35-8e5c-4c25-a078-0ffc897506ea tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2ae4c10>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:57.333531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f6b88c35-8e5c-4c25-a078-0ffc897506ea tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 200 len: 350 microversion: 2.1 time: 0.154435 May 27 03:23:57.334574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 11/19] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:57 2022] GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:58.126702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4ebcc9df-e2a9-4e50-a5ba-cd7e2dbab21f tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae9670>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.200885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4ebcc9df-e2a9-4e50-a5ba-cd7e2dbab21f tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 200 len: 288 microversion: 2.1 time: 0.076633 May 27 03:23:58.202187 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 12/20] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:23:58 2022] GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 288 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:58.212496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-dff81f05-55a5-4d55-bcb6-d1fdbfc6d84b tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae4ca0>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.374756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-dff81f05-55a5-4d55-bcb6-d1fdbfc6d84b tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 202 len: 0 microversion: 2.1 time: 0.166207 May 27 03:23:58.376838 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 13/21] 10.222.0.62 () {58 vars in 1253 bytes} [Fri May 27 03:23:58 2022] DELETE /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:23:58.383339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-feb050b9-2861-429a-a9d3-421f2501b857 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Calling method '.version_select at 0x7f40c2ae4550>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.403909 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:23:58.404439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:23:58.404849 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:23:58.405570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:23:58.406205 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:23:58.467969 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.468422 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.469218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.469651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.497147 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-feb050b9-2861-429a-a9d3-421f2501b857 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] HTTP exception thrown: Volume c7700b81-5c98-494b-8415-6c34ffd2db49 could not be found. May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-feb050b9-2861-429a-a9d3-421f2501b857 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Request method failure captured: May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 HTTP/1.1 May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERGe-KrrQgdu36-tlcVAHfmeuCL8-kS76tefkEarc8U81a5aZpyLa2azq0swXtUHy-TE3rLFMrGB-o6LuLefajQLgvxmnuDHVdOSYGUUdIoBoxwdckUQPlX9yu89ykR3V8QyiET3B-LTW5TYEga8NR9rq8N7KNioEbGcIBQsmhOb-U May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: ac9d7226b54c494893714280b2a9be32 May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesGetTestJSON-1408482953 May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:23:58.502124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ac9d7226b54c494893714280b2a9be32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ac9d7226b54c494893714280b2a9be32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ac9d7226b54c494893714280b2a9be32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ac9d7226b54c494893714280b2a9be32"}]}] May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesGetTestJSON-1408482953 May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: ac9d7226b54c494893714280b2a9be32 May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesGetTestJSON-1408482953 May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesGetTestJSON-1408482953-project May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 9c5ba513cf6b43c7b4908d6ef75ee493 May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesGetTestJSON-1408482953-project May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Volume c7700b81-5c98-494b-8415-6c34ffd2db49 could not be found. May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'c7700b81-5c98-494b-8415-6c34ffd2db49'} May 27 03:23:58.503300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7700b81-5c98-494b-8415-6c34ffd2db49 could not be found. (HTTP 404) (Request-ID: req-5ada5587-2399-4e16-89a7-47a8f8a857ce) May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:58.504032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:58.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7700b81-5c98-494b-8415-6c34ffd2db49 could not be found. May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:23:58.505946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7700b81-5c98-494b-8415-6c34ffd2db49 could not be found. May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7700b81-5c98-494b-8415-6c34ffd2db49 could not be found. May 27 03:23:58.507005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:23:58.508362 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-feb050b9-2861-429a-a9d3-421f2501b857 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] Returning 404 to user: Volume c7700b81-5c98-494b-8415-6c34ffd2db49 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:23:58.509346 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-feb050b9-2861-429a-a9d3-421f2501b857 tempest-VolumesGetTestJSON-1408482953 tempest-VolumesGetTestJSON-1408482953-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49" status: 404 len: 109 microversion: 2.1 time: 0.131303 May 27 03:23:58.510744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 14/22] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:58 2022] GET /compute/v2.1/os-volumes/c7700b81-5c98-494b-8415-6c34ffd2db49 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:23:58.533258 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-abe8ed39-b267-40d6-8abb-374a4ba912b2 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2ae9940>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.622338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Getting quotas for project de1626e5c02845f5b9b93e8b5fe916f0. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:58.627285 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-abe8ed39-b267-40d6-8abb-374a4ba912b2 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 200 len: 287 microversion: 2.1 time: 0.115301 May 27 03:23:58.628259 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 15/23] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:23:58 2022] GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:58.642894 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Getting quotas for user e4d835d78d4f4b019ced356585af16c7 and project de1626e5c02845f5b9b93e8b5fe916f0. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:58.667635 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:23:58.671586 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:23:58.880072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7616acac-8b2b-4dcd-af5c-f261d275c19b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.431734 May 27 03:23:58.881471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 9/24] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:23:58.893502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8fbfddfb-6109-46ca-966f-34633d954367 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.894207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8fbfddfb-6109-46ca-966f-34633d954367 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:59.172735 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8fbfddfb-6109-46ca-966f-34633d954367 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:59.197712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8fbfddfb-6109-46ca-966f-34633d954367 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1215 microversion: 2.1 time: 0.308847 May 27 03:23:59.198833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 16/25] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:23:58 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:59.203535 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7ecf3799-3711-44a2-9293-007c40aaf7fe tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2a14c10>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.264318 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7ecf3799-3711-44a2-9293-007c40aaf7fe tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25eb3a12-8a6d-4689-91f4-dc153992d196" status: 200 len: 350 microversion: 2.1 time: 0.064272 May 27 03:23:59.264912 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 17/26] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/os-volumes/25eb3a12-8a6d-4689-91f4-dc153992d196 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:59.277144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6b8f394c-b3bb-4291-919e-484d72b4bfb7 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2a22040>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.440793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6b8f394c-b3bb-4291-919e-484d72b4bfb7 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.168544 May 27 03:23:59.441370 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 18/27] 10.222.0.62 () {58 vars in 1133 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:59.453298 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f9f8fee7-e05f-42ed-b931-5a5f5f48a4f7 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2a14d30>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.467778 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7b983677-6614-4ace-917e-2f0abbeff6d1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'create', calling method: .version_select at 0x7f40c21e3670>, body: {"keypair": {"name": "tempest-keypair-1578402549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7hxxBVdoo5aOc88TiXOwJ/tmigPcNowpZ0RdcXmvHX/5WAFVSk99N11qNOr+M8d2C87U0gL1FFDNr0LtkQ60t9uyciJKEt9n2zl2hE9O/7RplW6Q0Y84plQb4JgQ+c0w=="}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:59.501227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-7b983677-6614-4ace-917e-2f0abbeff6d1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for project 3931210010614a1f987661568f29e851. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:59.507220 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-7b983677-6614-4ace-917e-2f0abbeff6d1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for user 720bd38555404aafa93db5ae49b13acf and project 3931210010614a1f987661568f29e851. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:59.594505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7b983677-6614-4ace-917e-2f0abbeff6d1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.622471 May 27 03:23:59.595814 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 10/28] 10.222.0.62 () {62 vars in 1199 bytes} [Fri May 27 03:23:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 625 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 03:23:59.629893 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f9f8fee7-e05f-42ed-b931-5a5f5f48a4f7 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.180237 May 27 03:23:59.630709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 19/29] 10.222.0.62 () {58 vars in 1148 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:59.658735 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fcd706aa-1f9e-4429-be67-9ecc797c7a0e tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2a22550>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.661860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fcb4973a-0e08-4e0f-af96-00f7727f017a tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c1996160>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.731297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-fcb4973a-0e08-4e0f-af96-00f7727f017a tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] HTTP exception thrown: Snapshot a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 could not be found. May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fcb4973a-0e08-4e0f-af96-00f7727f017a tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Request method failure captured: May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 HTTP/1.1 May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERGD1fuIMw1P-MPz9uGnPApKQyp4BndDfhkQuztxyc24xPfMmtWA_NOTKOJ6bMbHM1lfLtY9ZPHLnvrcAL64xHdirU6jOEaX9xUgpKYnzgj0jlGkW5qOckcCk89O7zbxZFs-zu9-iYE2EeRQKqIq7BXxC5U3eubOvfWxiRTU0uIpCo May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:23:59.738851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}] May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: f79a95f2221146a280a9d338c30be98a May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Snapshot a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 could not be found. May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'a51d36fe-414d-4cd7-bec6-17a30a8a2fc2'} May 27 03:23:59.740515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 could not be found. (HTTP 404) (Request-ID: req-e318e628-cb62-45da-9e19-06d4bc1878ae) May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:23:59.741437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:59.742435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 could not be found. May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 03:23:59.743491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 could not be found. May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 could not be found. May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fcb4973a-0e08-4e0f-af96-00f7727f017a tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Returning 404 to user: Snapshot a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:23:59.745438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fcb4973a-0e08-4e0f-af96-00f7727f017a tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2" status: 404 len: 111 microversion: 2.1 time: 0.092158 May 27 03:23:59.746149 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 11/30] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/os-snapshots/a51d36fe-414d-4cd7-bec6-17a30a8a2fc2 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:23:59.764100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-237ae0e6-f9d7-4c23-bf73-b99035ebbcb1 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c117c430>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.899098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fcd706aa-1f9e-4429-be67-9ecc797c7a0e tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.248204 May 27 03:23:59.904713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 20/31] 10.222.0.62 () {58 vars in 1133 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:59.923396 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5910d37a-1cd7-4899-8acc-fa86ca40127d tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2a29280>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.997548 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-237ae0e6-f9d7-4c23-bf73-b99035ebbcb1 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641" status: 202 len: 0 microversion: 2.1 time: 0.249371 May 27 03:24:00.003894 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 12/32] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:23:59 2022] DELETE /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:24:00.012754 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a6358be5-89cf-4a6c-8f75-23590c1b9356 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c21f7280>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:00.144943 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a6358be5-89cf-4a6c-8f75-23590c1b9356 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641" status: 200 len: 344 microversion: 2.1 time: 0.139556 May 27 03:24:00.145878 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 13/33] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:00.191391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5910d37a-1cd7-4899-8acc-fa86ca40127d tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.278132 May 27 03:24:00.193482 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 21/34] 10.222.0.62 () {58 vars in 1166 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:00.205746 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-11e95f17-e0d0-4130-9154-7e41f4f472e8 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c117c790>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:00.216052 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-19298935-9bb8-4e99-a80a-9d00abe16e86 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:00.217073 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-19298935-9bb8-4e99-a80a-9d00abe16e86 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:00.394032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-19298935-9bb8-4e99-a80a-9d00abe16e86 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:00.403907 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-19298935-9bb8-4e99-a80a-9d00abe16e86 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1215 microversion: 2.1 time: 0.193160 May 27 03:24:00.404797 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 22/35] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:00.468687 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-11e95f17-e0d0-4130-9154-7e41f4f472e8 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.266899 May 27 03:24:00.469996 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 14/36] 10.222.0.62 () {58 vars in 1169 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:00.482990 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-aa7c8ddb-1b0f-4b27-9580-148049fb4ab5 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2a22790>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:00.662971 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-aa7c8ddb-1b0f-4b27-9580-148049fb4ab5 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.185094 May 27 03:24:00.663538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 23/37] 10.222.0.62 () {58 vars in 1154 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:00.676531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-51c8c9e3-fee9-4ac4-8772-a5fedafa012a tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c117ce50>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:00.884749 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-51c8c9e3-fee9-4ac4-8772-a5fedafa012a tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.213314 May 27 03:24:00.885518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 15/38] 10.222.0.62 () {58 vars in 1187 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:00.897370 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-044fa528-19e1-4734-8c02-26483f0dbb63 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] Calling method '.version_select at 0x7f40c2a29a60>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:01.057806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-044fa528-19e1-4734-8c02-26483f0dbb63 tempest-VolumesTestJSON-868128030 tempest-VolumesTestJSON-868128030-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164244 May 27 03:24:01.058367 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 24/39] 10.222.0.62 () {58 vars in 1154 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:01.157935 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2c494ff1-cb43-492b-9b37-b8086bfb2354 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c117caf0>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:01.226938 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-2c494ff1-cb43-492b-9b37-b8086bfb2354 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] HTTP exception thrown: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2c494ff1-cb43-492b-9b37-b8086bfb2354 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Request method failure captured: May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 HTTP/1.1 May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERGD1fuIMw1P-MPz9uGnPApKQyp4BndDfhkQuztxyc24xPfMmtWA_NOTKOJ6bMbHM1lfLtY9ZPHLnvrcAL64xHdirU6jOEaX9xUgpKYnzgj0jlGkW5qOckcCk89O7zbxZFs-zu9-iYE2EeRQKqIq7BXxC5U3eubOvfWxiRTU0uIpCo May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:24:01.228570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}] May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: f79a95f2221146a280a9d338c30be98a May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '981c2c28-9bd6-4840-a3c6-c3d7b1169641'} May 27 03:24:01.229621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. (HTTP 404) (Request-ID: req-dcc9c9ae-efa5-4444-9434-00b89c21b19e) May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.230254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:24:01.232114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:24:01.233122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2c494ff1-cb43-492b-9b37-b8086bfb2354 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Returning 404 to user: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2c494ff1-cb43-492b-9b37-b8086bfb2354 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641" status: 404 len: 109 microversion: 2.1 time: 0.075791 May 27 03:24:01.234068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 16/40] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:24:01 2022] GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:24:01.245747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e1a6c5b1-674d-48c5-bdca-4c004a9765be tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c2a14f70>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:01.313296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-e1a6c5b1-674d-48c5-bdca-4c004a9765be tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] HTTP exception thrown: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e1a6c5b1-674d-48c5-bdca-4c004a9765be tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Request method failure captured: May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 HTTP/1.1 May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERGD1fuIMw1P-MPz9uGnPApKQyp4BndDfhkQuztxyc24xPfMmtWA_NOTKOJ6bMbHM1lfLtY9ZPHLnvrcAL64xHdirU6jOEaX9xUgpKYnzgj0jlGkW5qOckcCk89O7zbxZFs-zu9-iYE2EeRQKqIq7BXxC5U3eubOvfWxiRTU0uIpCo May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:24:01.316390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}] May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: f79a95f2221146a280a9d338c30be98a May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '981c2c28-9bd6-4840-a3c6-c3d7b1169641'} May 27 03:24:01.317710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. (HTTP 404) (Request-ID: req-3dcf4e01-911c-485a-bf2b-06a5e1e63de9) May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.318324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:24:01.319228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:24:01.320494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e1a6c5b1-674d-48c5-bdca-4c004a9765be tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Returning 404 to user: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e1a6c5b1-674d-48c5-bdca-4c004a9765be tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641" status: 404 len: 109 microversion: 2.1 time: 0.078123 May 27 03:24:01.321376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 25/41] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:24:01 2022] DELETE /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:24:01.330510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-943a1f33-db14-47de-8d66-2e21182cf737 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Calling method '.version_select at 0x7f40c117c040>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:01.386342 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-943a1f33-db14-47de-8d66-2e21182cf737 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] HTTP exception thrown: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-943a1f33-db14-47de-8d66-2e21182cf737 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Request method failure captured: May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 HTTP/1.1 May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERGD1fuIMw1P-MPz9uGnPApKQyp4BndDfhkQuztxyc24xPfMmtWA_NOTKOJ6bMbHM1lfLtY9ZPHLnvrcAL64xHdirU6jOEaX9xUgpKYnzgj0jlGkW5qOckcCk89O7zbxZFs-zu9-iYE2EeRQKqIq7BXxC5U3eubOvfWxiRTU0uIpCo May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:24:01.389479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7ba6e3acda8d4e41af12c7a79bf3bc3b"}]}] May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 7ba6e3acda8d4e41af12c7a79bf3bc3b May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-64652197 May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: f79a95f2221146a280a9d338c30be98a May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-VolumesSnapshotsTestJSON-64652197-project May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '981c2c28-9bd6-4840-a3c6-c3d7b1169641'} May 27 03:24:01.390605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. (HTTP 404) (Request-ID: req-dc6d0862-06e7-495d-ae95-e5155bb0b451) May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.391228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:24:01.392159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:24:01.393064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-943a1f33-db14-47de-8d66-2e21182cf737 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] Returning 404 to user: Volume 981c2c28-9bd6-4840-a3c6-c3d7b1169641 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-943a1f33-db14-47de-8d66-2e21182cf737 tempest-VolumesSnapshotsTestJSON-64652197 tempest-VolumesSnapshotsTestJSON-64652197-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641" status: 404 len: 109 microversion: 2.1 time: 0.067432 May 27 03:24:01.393941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 17/42] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:24:01 2022] GET /compute/v2.1/os-volumes/981c2c28-9bd6-4840-a3c6-c3d7b1169641 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:24:01.426253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-468cf501-0b55-4007-bf22-bcf23fa5c350 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:01.428183 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-468cf501-0b55-4007-bf22-bcf23fa5c350 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:01.590967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-468cf501-0b55-4007-bf22-bcf23fa5c350 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:01.614782 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-468cf501-0b55-4007-bf22-bcf23fa5c350 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1215 microversion: 2.1 time: 0.193676 May 27 03:24:01.616488 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 26/43] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:01 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:02.633690 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:02.634320 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:02.679319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.682573 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.685819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.688925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.601210 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:03.647866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-08673436-705b-4e38-9c79-66337dd74d65 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1275 microversion: 2.1 time: 1.018012 May 27 03:24:03.662672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 18/44] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:02 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1275 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:04.665757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:04.666960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:04.682954 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:04.686854 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:04.687968 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:04.689171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.525323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:05.579682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6180be22-bb4e-46da-bf8e-d355378a6a51 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1273 microversion: 2.1 time: 0.913800 May 27 03:24:05.596543 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 27/45] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:04 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1273 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:06.137557 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1537546055", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6e77ba9-a945-4d02-9449-8f38e42d0677"}], "security_groups": [{"name": "tempest-securitygroup--830820638"}], "key_name": "tempest-keypair-1578402549", "user_data": "}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:06.675166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] validate_networks() for [('a6e77ba9-a945-4d02-9449-8f38e42d0677', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:24:07.457652 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1189389876", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:07.729455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] validate_networks() for [('1891957d-4247-46a9-9554-49f7b2427352', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:24:08.541116 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:09.518781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=10 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:09.853411 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:24:09.854195 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:24:09.854545 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:24:09.855210 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:24:09.855597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:24:09.877846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.889890 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.892726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.895834 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.993864 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for project 3931210010614a1f987661568f29e851. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:24:10.005084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for user 720bd38555404aafa93db5ae49b13acf and project 3931210010614a1f987661568f29e851. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:24:10.031752 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:24:10.036604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:24:10.190496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-10b3b5f5-68bd-4147-bd5e-1e19a1024a8f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.059267 May 27 03:24:10.197088 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 19/46] 10.222.0.62 () {62 vars in 1187 bytes} [Fri May 27 03:24:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 4067 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 03:24:10.225571 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:10.230860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:10.258555 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.266189 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:10.267292 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.269309 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.105558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:24:11.107146 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:24:11.108387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:24:11.109085 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:24:11.109660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:24:11.162553 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:11.165124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.179129 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:11.181304 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.359281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:24:11.390533 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for user e8fddb1cf74d4135b41000f8a6293020 and project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:24:11.481404 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:24:11.484880 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:24:11.599739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:11.615492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a532cfce-0c50-4252-86d3-a16d7f2aa435 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 1.410854 May 27 03:24:11.618516 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 20/47] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:10 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:11.630992 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-28929038-7079-46c0-96e8-4f0b0999ef9e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:11.633461 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-28929038-7079-46c0-96e8-4f0b0999ef9e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:11.808458 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f9b2ac62-4eb9-433f-8dcf-8d1bc1544478 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.219938 May 27 03:24:11.811707 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 28/48] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:24:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 5224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:24:11.832942 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-aa249346-7d4d-4dcc-a9a1-474559bd7a51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:11.836886 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-aa249346-7d4d-4dcc-a9a1-474559bd7a51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:12.126425 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-aa249346-7d4d-4dcc-a9a1-474559bd7a51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.139346 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-aa249346-7d4d-4dcc-a9a1-474559bd7a51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1222 microversion: 2.1 time: 0.321462 May 27 03:24:12.139974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 29/49] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:11 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1222 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:12.310152 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-28929038-7079-46c0-96e8-4f0b0999ef9e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.369909 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-28929038-7079-46c0-96e8-4f0b0999ef9e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.386201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-28929038-7079-46c0-96e8-4f0b0999ef9e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.402510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-28929038-7079-46c0-96e8-4f0b0999ef9e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1282 microversion: 2.20 time: 0.780447 May 27 03:24:12.408046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 21/50] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:11 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1282 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:12.630217 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2125187797", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:12.880225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] validate_networks() for [('1891957d-4247-46a9-9554-49f7b2427352', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:24:12.913587 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-8cffd90d-b211-4b91-b8ef-8be6a980386a req-7c58a6db-f057-461c-a2f2-e84edcb3be3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044c7e01-8c46-4677-b931-aee2526ef362", "tag": "502ea12a-9820-4987-ba82-9d6c8aa95993"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:12.972174 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8cffd90d-b211-4b91-b8ef-8be6a980386a req-7c58a6db-f057-461c-a2f2-e84edcb3be3d service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:12.982414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8cffd90d-b211-4b91-b8ef-8be6a980386a req-7c58a6db-f057-461c-a2f2-e84edcb3be3d service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.078550 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-8cffd90d-b211-4b91-b8ef-8be6a980386a req-7c58a6db-f057-461c-a2f2-e84edcb3be3d service nova] Creating event network-changed:502ea12a-9820-4987-ba82-9d6c8aa95993 for instance 044c7e01-8c46-4677-b931-aee2526ef362 on hv-cinder-82880 May 27 03:24:13.079262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8cffd90d-b211-4b91-b8ef-8be6a980386a req-7c58a6db-f057-461c-a2f2-e84edcb3be3d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117609) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 03:24:13.083496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-076187b4-ea74-460c-af57-a4eff89bfa0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.084746 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-076187b4-ea74-460c-af57-a4eff89bfa0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.088148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-076187b4-ea74-460c-af57-a4eff89bfa0b None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.089105 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-076187b4-ea74-460c-af57-a4eff89bfa0b None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.128130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.compute.rpcapi [None req-076187b4-ea74-460c-af57-a4eff89bfa0b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 03:24:13.132326 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-076187b4-ea74-460c-af57-a4eff89bfa0b None None] Releasing lock "compute-rpcapi-router" {{(pid=117609) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 03:24:13.201608 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-076187b4-ea74-460c-af57-a4eff89bfa0b None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.645211 May 27 03:24:13.202122 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 30/51] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:13.225182 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:13.230157 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:13.258978 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.259512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.267011 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.267747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:14.098329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.106672 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d4c4d824-f395-40ff-b8d7-a5e111baa909 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.903255 May 27 03:24:14.117971 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 31/52] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:13 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:14.207426 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:24:14.207942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:24:14.208349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:24:14.208762 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:24:14.209176 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:24:14.225319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:14.225773 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:14.231634 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:14.233445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:14.272815 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:24:14.282546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for user e8fddb1cf74d4135b41000f8a6293020 and project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:24:14.307709 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:24:14.313642 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:24:14.422007 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fca66117-b6ae-47e3-92c7-ae31dbe82b51 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.795842 May 27 03:24:14.423118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 22/53] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:24:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:24:14.432453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:14.441720 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:14.460062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:14.460062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:14.462395 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:14.462852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:14.610515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.622041 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.623959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.625777 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9df6c9bd-dcb1-40df-81b4-d811f615986a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1278 microversion: 2.20 time: 0.201066 May 27 03:24:14.626493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 23/54] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:14 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:14.632248 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c2aee6b4-ad9f-4588-9aaa-38eabdef1b39 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:14.633099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c2aee6b4-ad9f-4588-9aaa-38eabdef1b39 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:14.637788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6326c7dd-d3e5-4677-9f52-c6d40e5a2e96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'create', calling method: .version_select at 0x7f40c1840160>, body: {"keypair": {"name": "tempest-keypair-166543922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrUI7kHl+Ue5k4XExz+l9XcEiq5ZgEpi4iKGzLhwMQWTR/0fNy1uMr/6M2iaYIfvo3A6q4h7tm+rW0cMmSq3Hx8SUOIVZX3fwO4+v37qU6xAPD0jV3VXdcNPVNgBXA/UA=="}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:14.711830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-6326c7dd-d3e5-4677-9f52-c6d40e5a2e96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for project b114bd896cc6469184097ef9300613da. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:24:14.732740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c2aee6b4-ad9f-4588-9aaa-38eabdef1b39 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.740463 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c2aee6b4-ad9f-4588-9aaa-38eabdef1b39 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1222 microversion: 2.1 time: 0.112782 May 27 03:24:14.742164 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-6326c7dd-d3e5-4677-9f52-c6d40e5a2e96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for user b34132c9382a44cd97bc2c4e40c97eec and project b114bd896cc6469184097ef9300613da. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:24:14.744200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 24/55] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:14 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:14.909076 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6326c7dd-d3e5-4677-9f52-c6d40e5a2e96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.789746 May 27 03:24:14.916061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 32/56] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:24:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:15.134798 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:15.137061 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:15.149178 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.158099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.158954 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.159403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.421128 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.432863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-edce29b4-71a8-4c95-b863-b048dd14f945 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.307725 May 27 03:24:15.433462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 25/57] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:15 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:15.646271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:15.647692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:15.664611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.665854 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.672805 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.672805 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.765534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:15.766364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:15.780471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.781008 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.785782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.787520 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.959886 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.979185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.983723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.987901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-88b38001-b81a-4036-b6e5-9168d58780c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1278 microversion: 2.20 time: 0.345755 May 27 03:24:15.990441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 33/58] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:15 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1278 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:16.031683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:16.039726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-566dbe0a-c2c8-4ac4-821f-9948bed9bfa5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1226 microversion: 2.1 time: 0.279701 May 27 03:24:16.046007 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 26/59] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:15 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1226 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:16.457453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:16.458198 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:16.471353 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.473124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.475344 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.477505 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.008802 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:17.009388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:17.031640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.032197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.035596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.037001 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.151711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.169725 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bb2d656d-ef97-4f93-9a87-93810ed4b456 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.720308 May 27 03:24:17.180882 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 34/60] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:16 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:17.207803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:17.209751 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:17.239576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.240168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.242267 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.243564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.319985 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.345156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.354126 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.358787 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-39267566-0e7c-40e6-aff6-cc4200e3a4d7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1334 microversion: 2.20 time: 0.350756 May 27 03:24:17.360957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 27/61] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:17 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1334 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:17.511888 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.536060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2bb1f773-cf14-4879-b1fd-cd112b31a82e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1218 microversion: 2.1 time: 0.352571 May 27 03:24:17.537790 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 35/62] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:17 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1218 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:18.189606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:18.190458 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:18.225852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.230794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.237007 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.238120 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.380960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:18.381846 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:18.404983 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.407183 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.412894 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.413704 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.586323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.598496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.607302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.613170 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1d6c342d-32e0-43f4-8e3a-a6669ae13682 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1340 microversion: 2.20 time: 0.233957 May 27 03:24:18.621525 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 36/63] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:18 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1340 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:18.640498 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:18.644849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:18.665735 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.668800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.669976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.670724 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.749836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.761882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a73ea013-d351-49ad-8590-0484fa76393b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.579788 May 27 03:24:18.776186 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 28/64] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:18 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:19.069027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.077812 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-de20e53d-69d9-4064-b164-5a44a9691da1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1282 microversion: 2.1 time: 0.446947 May 27 03:24:19.098877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 37/65] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:18 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1282 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:19.640160 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:19.640859 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:19.660622 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.664710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.666862 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.669808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.785159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:19.788401 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:19.812122 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.814862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.820108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.820604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.868318 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.895793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.897572 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.898808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-297c2729-5720-4e7b-84e1-8658e9503eb4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1340 microversion: 2.20 time: 0.263585 May 27 03:24:19.903469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 29/66] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:19 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:19.943734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1677889110", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98ca3cf1-95fa-41da-b7a2-51930fd197f1"}], "security_groups": [{"name": "tempest-securitygroup--1341527438"}], "key_name": "tempest-keypair-166543922", "user_data": "}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:20.139622 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] validate_networks() for [('98ca3cf1-95fa-41da-b7a2-51930fd197f1', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:24:20.316686 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:20.324767 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4aac1e98-8201-44ab-8f82-aaf0f4cb1afe tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.548460 May 27 03:24:20.330008 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 38/67] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:19 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:20.339340 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:20.339997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:20.342073 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:20.360406 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.361223 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.362756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.363153 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.393923 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:20.532534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:20.540318 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-69f642a8-8f3c-4b2e-94ef-b41e7a6cffbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1280 microversion: 2.1 time: 0.209152 May 27 03:24:20.540897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 39/68] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:20 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:20.722567 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:24:20.723377 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:24:20.724113 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:24:20.724570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:24:20.725158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:24:20.742882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.743336 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.744416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.744853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.752868 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=55 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:20.766702 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for project b114bd896cc6469184097ef9300613da. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:24:20.770509 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for user b34132c9382a44cd97bc2c4e40c97eec and project b114bd896cc6469184097ef9300613da. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:24:20.786557 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:24:20.789482 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:24:20.845193 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ae0af95b-266a-4ded-b1f2-d01f01b2dbaf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.907838 May 27 03:24:20.848071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 30/69] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:24:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:24:20.857570 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1d4e0275-549d-4984-bb23-81b70a053cd8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:20.858896 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1d4e0275-549d-4984-bb23-81b70a053cd8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:20.926500 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:20.926852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:20.946613 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.947312 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.950308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.952460 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.994265 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1d4e0275-549d-4984-bb23-81b70a053cd8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.009396 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=19 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:21.047207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1d4e0275-549d-4984-bb23-81b70a053cd8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1237 microversion: 2.1 time: 0.194118 May 27 03:24:21.048147 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 40/70] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:20 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:21.074235 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.090314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.095607 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.099391 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a51d7fad-c919-4e47-b02b-1333efec3804 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1340 microversion: 2.20 time: 0.185959 May 27 03:24:21.102428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 31/71] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:20 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1340 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:21.346475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:21.347241 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:21.353899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:21.354260 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:21.355651 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:21.356117 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:21.560112 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:21.560896 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:21.565738 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.574448 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d6095351-3c62-48b6-aef3-5d35effa74ac tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.231783 May 27 03:24:21.575021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 41/72] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:21 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:21.579572 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:21.580299 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:21.581390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:21.582006 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:21.668049 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.675799 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-090e1f2d-55de-47b0-944f-b5a8bcac1f27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1280 microversion: 2.1 time: 0.122595 May 27 03:24:21.676610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 32/73] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:21 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:22.067789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:22.068599 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:22.075601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.076394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.077387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.078061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.119118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:22.121302 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:22.129320 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.129957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.131211 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.131871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.147093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:22.159808 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-86abed25-bbc9-440c-b922-0c43f6069bcf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1241 microversion: 2.1 time: 0.096058 May 27 03:24:22.191573 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 42/74] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:22 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:22.293374 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:22.321012 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:22.323085 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:22.336706 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d0a68ff7-6af0-4007-ac56-6203c4201d87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1340 microversion: 2.20 time: 0.222913 May 27 03:24:22.337914 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 33/75] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:22 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1340 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:22.591270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:22.592211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:22.615376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.615866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.621960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.621960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.693336 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:22.693943 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:22.700853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.701552 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.702323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.702755 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.782842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:22.793906 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ea7ba425-dfd9-4354-80b2-17d48d3a3c4c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1280 microversion: 2.1 time: 0.104886 May 27 03:24:22.794490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 34/76] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:22 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:23.023645 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.052745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e0e4f783-bcf7-4a32-8a70-e4880318e37d tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.466008 May 27 03:24:23.053333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 43/77] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:22 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:23.179210 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:23.184986 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:23.196512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.198305 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.204445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.205063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.274704 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.284276 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ebf29309-4cd3-47e1-9506-917d4d1253bd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1241 microversion: 2.1 time: 0.110727 May 27 03:24:23.286322 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 35/78] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:23 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:23.355006 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:23.355621 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:23.357460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=4 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:23.368890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.369341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.370163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.370600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.511860 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.524238 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.525797 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.529960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fb30abdc-f90f-4f66-8c3a-06e0e7c76dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1340 microversion: 2.20 time: 0.179331 May 27 03:24:23.534069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 44/79] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:23 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1340 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:23.812685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:23.813759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:23.821466 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.822117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.823088 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.823771 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.988553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.996772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b0909a0a-1037-4135-884d-caf4dcb5b3ad tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1280 microversion: 2.1 time: 0.189489 May 27 03:24:24.007239 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 36/80] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:23 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:24.069206 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:24.069744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:24.091546 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.092031 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.093125 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.093768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.302849 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:24.304104 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:24.322048 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.323150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.324289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.325978 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.849640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:24.857116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-71aee70b-9e04-43af-8617-ae89681a01bb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.791671 May 27 03:24:24.857692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 45/81] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:24 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:24.870748 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:24.872558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:24.882078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:24.885407 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.889664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.890673 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.893228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.897469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-854424fe-c0de-4c9e-b37b-c9e526b9c0e7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1233 microversion: 2.1 time: 0.596411 May 27 03:24:24.908926 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 37/82] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:24 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1233 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:25.014444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:25.015488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:25.028388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.029545 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.033142 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.035483 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.035641 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:25.044402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:25.051171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:25.052372 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a0d40bcf-3251-490e-a02b-170bddcd97c6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1340 microversion: 2.20 time: 0.185969 May 27 03:24:25.056240 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 46/83] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:24 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1340 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:25.192365 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:25.205360 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-db60a215-1027-4c03-b17a-886500514dd2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1280 microversion: 2.1 time: 0.193611 May 27 03:24:25.216552 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 38/84] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:25 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:25.875109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:25.875719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:25.886730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.888870 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.889905 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.891922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.926390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:25.928110 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:25.932783 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:25.960596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.961049 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.968090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.971166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.381497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:26.393846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f701fd5c-3309-4130-afd8-7a96d4a5242d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1297 microversion: 2.1 time: 0.482622 May 27 03:24:26.406750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 39/85] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:25 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1297 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:26.409817 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:26.410450 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:26.422856 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.423345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.424975 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.426138 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.595341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:26.608419 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1a4a6367-358b-4791-87c0-7249eea4aafb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.736767 May 27 03:24:26.611089 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 47/86] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:25 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:26.626918 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:26.631210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:26.650293 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.651788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.652656 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.653092 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.768600 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:26.791962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:26.809090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:26.815595 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5ffc59b8-65af-4326-8f39-4c5fcdb890b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.409364 May 27 03:24:26.820133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 40/87] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:26 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:26.841643 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:26.852702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-dee5b5db-acab-41ab-b5ab-87d13b146477 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1280 microversion: 2.1 time: 0.239685 May 27 03:24:26.871091 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 48/88] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:26 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:27.414389 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:27.415938 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:27.437785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:27.438237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:27.441017 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:27.441757 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:27.607710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:27.629837 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:27.630678 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:27.643225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c7c6a57e-5654-49ee-a458-50ab873f009c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1295 microversion: 2.1 time: 0.231658 May 27 03:24:27.644781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 41/89] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:27 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1295 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:27.653910 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:27.656540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:27.664119 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:27.664575 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:27.844794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:27.845781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:27.909413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:27.911843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:27.923275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:27.923736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:28.393163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:28.402449 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d089c3e0-a9f3-47a6-9821-74cdfb1a521a tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.779337 May 27 03:24:28.412095 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 49/90] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:27 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:28.417165 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:28.417856 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:28.431753 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:28.432613 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:28.433623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:28.434257 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:28.951491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:28.962811 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:28.965923 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:28.973087 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cea39e9a-84fc-4b6b-8a65-1989ca783d41 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 1.133942 May 27 03:24:28.976447 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 42/91] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:27 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:28.981619 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-20f90a09-76c1-4e23-a8d3-060ca4bbfd75 req-1f32c506-2af6-4344-a879-2e4215be90bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668956ce-1a9e-43d1-a8d9-6ed759ad30f3", "tag": "906f93e1-97e9-4418-8ad2-066ad5cfe98a"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:29.014335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-20f90a09-76c1-4e23-a8d3-060ca4bbfd75 req-1f32c506-2af6-4344-a879-2e4215be90bc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.016832 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-20f90a09-76c1-4e23-a8d3-060ca4bbfd75 req-1f32c506-2af6-4344-a879-2e4215be90bc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.061889 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-20f90a09-76c1-4e23-a8d3-060ca4bbfd75 req-1f32c506-2af6-4344-a879-2e4215be90bc service nova] Creating event network-changed:906f93e1-97e9-4418-8ad2-066ad5cfe98a for instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 on hv-cinder-82880 May 27 03:24:29.064413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-20f90a09-76c1-4e23-a8d3-060ca4bbfd75 req-1f32c506-2af6-4344-a879-2e4215be90bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=117610) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 03:24:29.066124 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2e3f301-023b-4cd2-bdd5-4d4a1a87b6f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.067255 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2e3f301-023b-4cd2-bdd5-4d4a1a87b6f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.068251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2e3f301-023b-4cd2-bdd5-4d4a1a87b6f9 None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.068941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2e3f301-023b-4cd2-bdd5-4d4a1a87b6f9 None None] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.079649 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.compute.rpcapi [None req-a2e3f301-023b-4cd2-bdd5-4d4a1a87b6f9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 03:24:29.081070 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2e3f301-023b-4cd2-bdd5-4d4a1a87b6f9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117610) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 03:24:29.114812 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a2e3f301-023b-4cd2-bdd5-4d4a1a87b6f9 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137065 May 27 03:24:29.115929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 43/92] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:29.124259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:29.126676 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:29.136106 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.137202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.143320 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.144131 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.351159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:29.362925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c8a828e2-01d1-4f27-b0e3-f3ce8cf8085f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1295 microversion: 2.1 time: 0.244161 May 27 03:24:29.365244 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 44/93] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:29 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1295 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:29.455395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:29.464315 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-3146cdf6-b817-4187-9654-0e55fa3e419f req-22c301a6-476b-4abf-82ef-0f4d1ec41553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66633a35-54c4-43cf-9173-307af9be25ed", "tag": "24e06267-7c42-4615-b99c-ea36432e8bbc"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:29.464955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e779b593-3403-4f5f-b2e7-c86cb0fd5fd4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 1.051485 May 27 03:24:29.465969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 50/94] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:28 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:29.513609 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3146cdf6-b817-4187-9654-0e55fa3e419f req-22c301a6-476b-4abf-82ef-0f4d1ec41553 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.514339 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3146cdf6-b817-4187-9654-0e55fa3e419f req-22c301a6-476b-4abf-82ef-0f4d1ec41553 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.535424 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-3146cdf6-b817-4187-9654-0e55fa3e419f req-22c301a6-476b-4abf-82ef-0f4d1ec41553 service nova] Creating event network-changed:24e06267-7c42-4615-b99c-ea36432e8bbc for instance 66633a35-54c4-43cf-9173-307af9be25ed on hv-cinder-82880 May 27 03:24:29.545874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-3146cdf6-b817-4187-9654-0e55fa3e419f req-22c301a6-476b-4abf-82ef-0f4d1ec41553 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179058 May 27 03:24:29.547696 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 45/95] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:29.561986 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:29.563416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:29.579159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.579967 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.583271 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.586058 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.607015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-18714663-3165-4b00-b2a5-09f16cdc3483 req-b589f39b-f111-44b3-95c8-f0bfc7e2241a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044c7e01-8c46-4677-b931-aee2526ef362", "name": "network-vif-plugged", "status": "completed", "tag": "502ea12a-9820-4987-ba82-9d6c8aa95993"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:29.624083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-18714663-3165-4b00-b2a5-09f16cdc3483 req-b589f39b-f111-44b3-95c8-f0bfc7e2241a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.629643 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-18714663-3165-4b00-b2a5-09f16cdc3483 req-b589f39b-f111-44b3-95c8-f0bfc7e2241a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.661496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-18714663-3165-4b00-b2a5-09f16cdc3483 req-b589f39b-f111-44b3-95c8-f0bfc7e2241a service nova] Creating event network-vif-plugged:502ea12a-9820-4987-ba82-9d6c8aa95993 for instance 044c7e01-8c46-4677-b931-aee2526ef362 on hv-cinder-82880 May 27 03:24:29.674160 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-18714663-3165-4b00-b2a5-09f16cdc3483 req-b589f39b-f111-44b3-95c8-f0bfc7e2241a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206185 May 27 03:24:29.678041 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 51/96] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:29.995001 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:29.995704 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:30.005530 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.005885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.006810 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.023950 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.227097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:30.237091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-36714afd-8be2-47fd-8f64-d700f667b532 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.686708 May 27 03:24:30.237884 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 46/97] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:29 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:30.382379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:30.382873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:30.396640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.396901 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.403976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.406363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.676403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:30.686729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-49118465-98e6-4762-a87b-b4639ac8fa01 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.308049 May 27 03:24:30.688847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 47/98] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:30 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:30.709172 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:30.713709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:30.723832 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:30.731318 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:30.732908 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:30.750781 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-75540994-125d-44dc-b854-a3c9710a3f26 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.760185 May 27 03:24:30.754728 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.755184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.767233 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 52/99] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:29 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:30.773933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.774387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.780571 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=22 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:30.810656 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:31.110912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:31.123858 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-623ea4f5-743a-4fba-8001-10aee839c382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.431793 May 27 03:24:31.123858 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 48/100] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:30 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:31.256459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:31.257177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:31.265512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.266501 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.270599 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-32521f6f-31ba-45e0-b309-19638781755e req-1314bd7c-e5e8-4154-95d1-550f68c1441f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f", "tag": "c41e6da8-005c-4d31-9ffa-09feba8629e5"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:31.271123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.271484 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.294181 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-32521f6f-31ba-45e0-b309-19638781755e req-1314bd7c-e5e8-4154-95d1-550f68c1441f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.294791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-32521f6f-31ba-45e0-b309-19638781755e req-1314bd7c-e5e8-4154-95d1-550f68c1441f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.309977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-32521f6f-31ba-45e0-b309-19638781755e req-1314bd7c-e5e8-4154-95d1-550f68c1441f service nova] Creating event network-changed:c41e6da8-005c-4d31-9ffa-09feba8629e5 for instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f on hv-cinder-82880 May 27 03:24:31.316094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-32521f6f-31ba-45e0-b309-19638781755e req-1314bd7c-e5e8-4154-95d1-550f68c1441f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049979 May 27 03:24:31.317268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 49/101] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:24:31.354120 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:31.709193 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:31.710983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:31.719192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.720201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.721624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.722263 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.908334 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:31.917308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7abfc220-d5e7-4804-ae66-79fdf7bd984d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.215536 May 27 03:24:31.919800 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 50/102] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:31 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:31.927648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:31.939801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:31.945024 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:31.949540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4db0b63c-c2ba-4bf5-bdfe-063dc16c15f2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.696705 May 27 03:24:31.950267 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 53/103] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:31 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:31.957333 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.958482 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.959546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.960520 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:32.141781 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:32.142159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:32.148479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:32.149139 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:32.150085 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:32.150583 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:32.188328 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:32.200392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:32.203768 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:32.207413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e3f8a155-8c9a-49ce-8952-cb6259e09edd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.285403 May 27 03:24:32.208974 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 51/104] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:31 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:32.485481 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:32.498265 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1617042a-4dcf-47df-ac53-0736b59316db tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.361587 May 27 03:24:32.499172 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 54/105] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:32 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:32.937380 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:32.940223 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:32.950490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:32.951683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:32.953826 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:32.958447 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:32.970302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:32.971032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:32.982293 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:32.988983 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:32.992703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:32.993151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.190165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:33.200132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7c2040ae-6850-415e-9c63-3a8596e49246 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.266448 May 27 03:24:33.201937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 52/106] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:32 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:33.243254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.243983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:33.258474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:33.258935 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.259764 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:33.260416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.434387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:33.446660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-08e3b17c-14fa-49b7-9d0a-2ef759884be0 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1315 microversion: 2.1 time: 0.483813 May 27 03:24:33.452581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 55/107] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:32 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:33.518329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.518949 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:33.537820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:33.538817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.541008 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:33.543520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.559724 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:33.576580 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:33.578250 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:33.579386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9acbf9eb-6a42-4070-9750-d1ca0ba4ff53 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.348036 May 27 03:24:33.580274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 53/108] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:33.692525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-cea39d3f-ff41-4aed-aed4-f98f7cb02eb9 req-3c0ae3eb-2e29-44e0-b153-be536de1ed72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a8db13-6978-4562-918e-29f8ca94ef3f", "tag": "5f209ba7-5949-4139-a03b-ee0ae3138cea"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:33.704221 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cea39d3f-ff41-4aed-aed4-f98f7cb02eb9 req-3c0ae3eb-2e29-44e0-b153-be536de1ed72 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:33.706041 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cea39d3f-ff41-4aed-aed4-f98f7cb02eb9 req-3c0ae3eb-2e29-44e0-b153-be536de1ed72 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.724020 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-cea39d3f-ff41-4aed-aed4-f98f7cb02eb9 req-3c0ae3eb-2e29-44e0-b153-be536de1ed72 service nova] Creating event network-changed:5f209ba7-5949-4139-a03b-ee0ae3138cea for instance 15a8db13-6978-4562-918e-29f8ca94ef3f on hv-cinder-82880 May 27 03:24:33.730319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-cea39d3f-ff41-4aed-aed4-f98f7cb02eb9 req-3c0ae3eb-2e29-44e0-b153-be536de1ed72 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041307 May 27 03:24:33.731454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 54/109] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:24:33.831496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:33.852197 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4d850901-1d29-4212-b999-8ae7bea87de6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.340415 May 27 03:24:33.853122 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 56/110] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:34.219365 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.220262 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:34.231222 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.233934 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.235808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.237605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.414684 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:34.424173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2784e310-762f-4a28-8db9-0503e90fa691 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.209340 May 27 03:24:34.425565 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 55/111] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:34 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:34.466350 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.467476 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:34.478874 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.479321 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.480124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.480558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.597023 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.597968 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:34.608004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.609412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.610579 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.611556 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.832244 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:34.846055 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:34.848239 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:34.850791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b284de82-a050-41ff-b558-98cf5b848ba8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.256651 May 27 03:24:34.863082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 56/112] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:34 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:34.872516 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.874016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:34.882748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.883788 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.885411 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.886076 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.984421 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:35.000531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-266fea3a-6d09-47ea-afcc-c058ff331acb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1502 microversion: 2.1 time: 0.538849 May 27 03:24:35.014572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 57/113] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:34 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1502 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:35.100291 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:35.110118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9f45777a-ae57-46d1-8bad-d9265c22f6d9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.243380 May 27 03:24:35.114554 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 57/114] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:34 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:35.378760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-2edcc436-279e-4438-b67f-8519977c1019 req-a6c1bfef-7436-4f7f-be8b-53265f8dc748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66633a35-54c4-43cf-9173-307af9be25ed", "name": "network-vif-plugged", "status": "completed", "tag": "24e06267-7c42-4615-b99c-ea36432e8bbc"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:35.402156 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2edcc436-279e-4438-b67f-8519977c1019 req-a6c1bfef-7436-4f7f-be8b-53265f8dc748 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:35.403531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2edcc436-279e-4438-b67f-8519977c1019 req-a6c1bfef-7436-4f7f-be8b-53265f8dc748 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:35.423947 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-2edcc436-279e-4438-b67f-8519977c1019 req-a6c1bfef-7436-4f7f-be8b-53265f8dc748 service nova] Creating event network-vif-plugged:24e06267-7c42-4615-b99c-ea36432e8bbc for instance 66633a35-54c4-43cf-9173-307af9be25ed on hv-cinder-82880 May 27 03:24:35.434788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-2edcc436-279e-4438-b67f-8519977c1019 req-a6c1bfef-7436-4f7f-be8b-53265f8dc748 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063428 May 27 03:24:35.442548 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:35.444258 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:35.450167 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 58/115] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:35.453277 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:35.454582 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:35.456322 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:35.457063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:35.799615 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:35.817294 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b68780a4-6a0a-44cd-aaa0-04f12e099c88 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.379727 May 27 03:24:35.818371 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 58/116] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:35 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:35.869858 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:35.870566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:35.878111 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:35.880664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:35.881635 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:35.882220 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.131423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:36.132493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:36.141443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.142125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.143261 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.143891 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.270951 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:36.280043 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:36.288238 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:36.289362 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-320e42b8-de8b-4a94-b966-072b6d5870af tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.424390 May 27 03:24:36.289915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 59/117] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:35 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:36.325193 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:36.333100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9eba9075-2075-40a9-aaa5-ababcb37cc82 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.206229 May 27 03:24:36.333653 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 59/118] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:36 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:36.635885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-85baf332-1e0a-4d6c-ae18-3c870d7f87f7 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb2100fe-4324-4edf-a955-31b4b34b837f"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:36.637177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-85baf332-1e0a-4d6c-ae18-3c870d7f87f7 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:36.644393 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85baf332-1e0a-4d6c-ae18-3c870d7f87f7 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.644839 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85baf332-1e0a-4d6c-ae18-3c870d7f87f7 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.645597 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85baf332-1e0a-4d6c-ae18-3c870d7f87f7 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.646027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85baf332-1e0a-4d6c-ae18-3c870d7f87f7 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.834870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:36.835468 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:36.842607 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.843507 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.844458 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.844886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.050363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:37.060289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4a89e8a5-dc33-40f9-a39a-2bf14a871b0d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.229373 May 27 03:24:37.060863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 60/119] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:36 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:37.309226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:37.310313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:37.321784 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:37.322278 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.323084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:37.324350 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.496513 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:37.511045 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:37.524608 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:37.526583 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-547ea9fc-1a0b-4e3f-983d-cb2435881acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.222336 May 27 03:24:37.529357 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 61/120] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:37 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:37.543149 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:37.543614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:37.557608 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:37.557608 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.557932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:37.558376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.792046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:37.801306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e2b94d46-d41b-4aa1-bd9d-b103ab341177 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.269705 May 27 03:24:37.802123 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 62/121] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:37 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:37.807941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-e2ec922c-ff4e-4555-aafe-65260249b799 req-bccab2a8-9ca9-42bb-91b9-c977865d36cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668956ce-1a9e-43d1-a8d9-6ed759ad30f3", "name": "network-vif-plugged", "status": "completed", "tag": "906f93e1-97e9-4418-8ad2-066ad5cfe98a"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:37.818845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-e2ec922c-ff4e-4555-aafe-65260249b799 req-bccab2a8-9ca9-42bb-91b9-c977865d36cc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:37.819531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-e2ec922c-ff4e-4555-aafe-65260249b799 req-bccab2a8-9ca9-42bb-91b9-c977865d36cc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.838552 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-e2ec922c-ff4e-4555-aafe-65260249b799 req-bccab2a8-9ca9-42bb-91b9-c977865d36cc service nova] Creating event network-vif-plugged:906f93e1-97e9-4418-8ad2-066ad5cfe98a for instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 on hv-cinder-82880 May 27 03:24:37.844039 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-e2ec922c-ff4e-4555-aafe-65260249b799 req-bccab2a8-9ca9-42bb-91b9-c977865d36cc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040565 May 27 03:24:37.844645 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 63/122] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:38.082772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:38.083691 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:38.091661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.092175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:38.092939 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.093517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:38.232884 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:38.240361 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-1efedcdd-f7d2-47ae-b6ea-a251db9c6fd0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.162894 May 27 03:24:38.241573 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 64/123] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:38 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:38.561674 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:38.562323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:38.570605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.571051 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:38.575254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.575699 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:38.741883 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:38.751169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:38.752725 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:38.753828 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a1b3a5e2-9099-4586-9da4-9bf9260f2db2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.204657 May 27 03:24:38.754380 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 65/124] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:38 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:38.818201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:38.818936 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:38.825363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.825913 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:38.826750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.827351 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:38.999528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:39.009943 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-076c0a8d-80d1-40ef-b09f-2fd20ecc62b8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.195550 May 27 03:24:39.011062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 66/125] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:38 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:39.269251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:39.270298 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:39.272439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=8 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:39.286485 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:39.286891 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:39.287676 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:39.288142 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:39.293893 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:39.430855 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:39.442531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3b706644-204e-4e4e-8f78-7be1cc210e18 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.188086 May 27 03:24:39.443101 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 67/126] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:39 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:39.770594 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:39.771216 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:39.781353 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:39.781804 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:39.782570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:39.782998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:39.976869 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:39.986413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:39.988272 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:39.989477 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e2cbdb8b-55ca-41cb-8c32-5a57c666b1a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.223025 May 27 03:24:40.001026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 68/127] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:39 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:40.028120 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:40.029256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:40.038433 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:40.039106 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:40.039972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:40.040409 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:40.185589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:40.196763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ae066087-07c2-4be6-9128-a6eb5f85b90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.174169 May 27 03:24:40.197658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 69/128] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:40 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:40.459706 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:40.460349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:40.466720 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:40.467366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:40.468323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:40.468759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:40.616658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:40.624870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6e3d9129-46a2-4727-8e27-6884b8bfce30 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.169156 May 27 03:24:40.625655 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 70/129] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:40 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:40.941684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-85baf332-1e0a-4d6c-ae18-3c870d7f87f7 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "POST /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.299790 May 27 03:24:40.941684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 60/130] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:24:36 2022] POST /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362/os-volume_attachments => generated 194 bytes in 4310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:41.010794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:41.011983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:41.020870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.021304 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.022091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.022718 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.177036 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:41.186270 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:41.188027 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:41.189140 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-111b3d0d-69a9-4ab4-9f5a-348175494819 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.182968 May 27 03:24:41.190166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 71/131] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:41 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:41.216908 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:41.218618 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:41.232228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.232876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.233900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.235062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.440954 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:41.452361 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-42c29161-59f1-4c23-9319-af52fbbe17e5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.241600 May 27 03:24:41.453037 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 61/132] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:41 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:41.647458 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:41.648096 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:41.655297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.655743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.656539 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.656972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.791374 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:41.801098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-72e3252d-9af0-4501-9164-cb878e77e83f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.157077 May 27 03:24:41.801813 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 72/133] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:41 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:42.207616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:42.208550 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:42.216365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.216811 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:42.217557 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.218165 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:42.359312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:42.367851 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:42.369383 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:42.370912 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a0be7769-c41e-48d0-babd-28182a758efe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.167837 May 27 03:24:42.371463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 62/134] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:42 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:42.469591 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:42.470315 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:42.473448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:42.477197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.477659 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:42.478802 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.479419 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:42.637558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:42.645932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5548bbeb-fe4a-4776-a506-f7ebfef3d838 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.180271 May 27 03:24:42.646505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 73/135] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:42 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:42.818378 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:42.819157 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:42.828068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.828749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:42.830105 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.830935 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:43.001696 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:43.011974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-eafdc4b3-3aca-4873-ac54-678c5795ee41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.197099 May 27 03:24:43.013099 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 63/136] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:42 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:43.390203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:43.390797 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:43.396797 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:43.397255 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:43.397974 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:43.398395 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:43.662282 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:43.664169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:43.664782 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:43.671463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:43.671950 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:43.672173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:43.672717 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:43.673146 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:43.673729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:43.675218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0fabe039-d6da-4bb5-9492-7aa36695ec28 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.288961 May 27 03:24:43.676156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 74/137] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:43 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:43.677560 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:43.807267 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:43.814630 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-10eac5f0-e8d4-4191-903b-7c6fc69a5586 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.155663 May 27 03:24:43.815193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 64/138] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:43 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:44.028868 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:44.029477 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:44.035446 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.035929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:44.036680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.037113 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:44.166139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:44.173801 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a8beb5b8-0b3e-48bc-b0f1-f96ce37ba1ae tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.148789 May 27 03:24:44.174659 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 75/139] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:44 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:44.693612 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:44.694208 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:44.701774 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.702219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:44.702989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.703777 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:44.833880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:44.835133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:44.843510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.844119 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:44.845640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.846837 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:44.856420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:44.858329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:44.859594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9a1bcab4-1cdc-4ab7-b461-eb195f23ee68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.169856 May 27 03:24:44.860662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 65/140] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:44 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:44.882001 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:45.054638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:45.063163 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d0268568-68a8-47dc-9b14-52aa7e1f0a1f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.234763 May 27 03:24:45.063718 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 76/141] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:44 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:45.191682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:45.192311 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:45.199049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:45.199494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:45.200284 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:45.200703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:45.332100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:45.339978 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-995b1987-3821-4d93-a52b-a0c4824151e8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.152145 May 27 03:24:45.340568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 66/142] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:45 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:45.884062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:45.884660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:45.890599 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:45.891038 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:45.891781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:45.892232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:46.016037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:46.024118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:46.026179 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:46.027391 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e17099bc-42f6-41e4-8fd2-28f0c50c3570 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.147218 May 27 03:24:46.028016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 77/143] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:45 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:46.080449 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:46.081053 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:46.088009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:46.088453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:46.089213 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:46.089641 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:46.357713 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:46.358317 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:46.364606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:46.365104 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:46.365860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:46.366287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:46.385811 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:46.394259 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d83fda75-d2df-4fc7-8742-b83355e150d8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.317855 May 27 03:24:46.394825 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 67/144] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:46 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:46.496756 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:46.504072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6bb5e960-cf76-4191-83b3-105d4aebcbf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.150210 May 27 03:24:46.504633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 78/145] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:46 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:47.045061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:47.045668 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:47.052364 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:47.052947 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:47.053710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:47.054143 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:47.193586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:47.201517 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:47.203008 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:47.204168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a6689b86-c33f-4550-894b-eabf5dbd6766 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.162792 May 27 03:24:47.205475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 68/146] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:47 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:47.412188 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:47.413128 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:47.419754 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:47.420338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:47.421203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:47.422683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:47.520862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:47.521514 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:47.529200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:47.529654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:47.530456 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:47.530889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:47.568226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:47.576310 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-551611da-8181-4300-af8d-c2a4a310e4c7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.168076 May 27 03:24:47.576969 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 79/147] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:47 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:47.671327 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:47.678946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d94e5a84-3adc-41cd-8fe5-511127297298 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.162305 May 27 03:24:47.679675 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 69/148] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:47 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:48.221632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:48.222227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:48.228511 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:48.228948 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:48.229685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:48.230105 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:48.354228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:48.362067 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:48.363591 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:48.364749 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-66d66459-e7aa-436c-a640-19b688652669 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1407 microversion: 2.20 time: 0.146890 May 27 03:24:48.365297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 80/149] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:48 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:48.593337 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:48.593945 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:48.600433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:48.600881 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:48.601637 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:48.602067 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:48.697227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:48.697825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:48.710330 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:48.710772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:48.711542 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:48.712610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:48.754219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:48.761955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2e7e2069-51c2-4726-8e63-96d3730aef27 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.172318 May 27 03:24:48.762692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 70/150] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:48 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:48.782826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-7b4572bb-2c88-43b0-975a-e99eebfc90a4 req-6caf679b-18bd-4df4-a1e8-e93cc587f160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f", "name": "network-vif-plugged", "status": "completed", "tag": "c41e6da8-005c-4d31-9ffa-09feba8629e5"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:48.801841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-7b4572bb-2c88-43b0-975a-e99eebfc90a4 req-6caf679b-18bd-4df4-a1e8-e93cc587f160 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:48.802277 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-7b4572bb-2c88-43b0-975a-e99eebfc90a4 req-6caf679b-18bd-4df4-a1e8-e93cc587f160 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:48.815027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-7b4572bb-2c88-43b0-975a-e99eebfc90a4 req-6caf679b-18bd-4df4-a1e8-e93cc587f160 service nova] Creating event network-vif-plugged:c41e6da8-005c-4d31-9ffa-09feba8629e5 for instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f on hv-cinder-82880 May 27 03:24:48.820428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-7b4572bb-2c88-43b0-975a-e99eebfc90a4 req-6caf679b-18bd-4df4-a1e8-e93cc587f160 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041096 May 27 03:24:48.821025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 71/151] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:48.904048 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:48.912233 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-693e026b-5321-4cfb-a6e3-ff6e08b8a7ad tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.219539 May 27 03:24:48.912825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 81/152] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:48 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:49.383013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:49.383702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:49.390610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.391106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.391937 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.392487 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.529495 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:49.538930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:49.540713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:49.542088 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f3f8b412-271e-4d07-8ad3-a38039356082 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1598 microversion: 2.20 time: 0.163313 May 27 03:24:49.543215 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 72/153] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:24:49 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:49.562184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ecc1b597-a159-43bf-838f-b873d868f78e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:49.564526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ecc1b597-a159-43bf-838f-b873d868f78e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:49.575208 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ecc1b597-a159-43bf-838f-b873d868f78e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.575648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ecc1b597-a159-43bf-838f-b873d868f78e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.576436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ecc1b597-a159-43bf-838f-b873d868f78e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.576860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ecc1b597-a159-43bf-838f-b873d868f78e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.727584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ecc1b597-a159-43bf-838f-b873d868f78e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.170169 May 27 03:24:49.729606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 82/154] 10.222.0.62 () {60 vars in 1315 bytes} [Fri May 27 03:24:49 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:24:49.780791 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:49.782159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:49.790841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.791997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.793712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.794428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.929386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:49.930001 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:49.941747 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.942264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.943037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.943469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:50.140772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:50.149442 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3cc2fb32-e67c-43e7-a765-1dd950ce34e5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.223796 May 27 03:24:50.159851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 83/155] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:49 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:50.338013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:50.370669 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6a9fc3bc-70b7-489a-b7ed-639e6e384646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1322 microversion: 2.1 time: 0.592878 May 27 03:24:50.371491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 73/156] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:49 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:50.839416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-c50c848d-5604-4c86-9134-3f4fdff88fe1 req-528da947-1b21-49fe-8f72-f4f1f051ade1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a8db13-6978-4562-918e-29f8ca94ef3f", "name": "network-vif-plugged", "status": "completed", "tag": "5f209ba7-5949-4139-a03b-ee0ae3138cea"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:50.848241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c50c848d-5604-4c86-9134-3f4fdff88fe1 req-528da947-1b21-49fe-8f72-f4f1f051ade1 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:50.848711 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c50c848d-5604-4c86-9134-3f4fdff88fe1 req-528da947-1b21-49fe-8f72-f4f1f051ade1 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:50.858832 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:50.861782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-c50c848d-5604-4c86-9134-3f4fdff88fe1 req-528da947-1b21-49fe-8f72-f4f1f051ade1 service nova] Creating event network-vif-plugged:5f209ba7-5949-4139-a03b-ee0ae3138cea for instance 15a8db13-6978-4562-918e-29f8ca94ef3f on hv-cinder-82880 May 27 03:24:50.867981 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-c50c848d-5604-4c86-9134-3f4fdff88fe1 req-528da947-1b21-49fe-8f72-f4f1f051ade1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 May 27 03:24:50.868819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 84/157] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:51.167419 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:51.167419 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:51.173543 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=72 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:51.175068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.175521 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.176370 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.176810 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.391913 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:51.393163 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:51.411425 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.412031 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.412814 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.413444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.613115 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:51.621061 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-465b5772-2ae3-48a7-80c5-e86411a23c94 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1516 microversion: 2.1 time: 0.235729 May 27 03:24:51.622048 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:51.622279 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 85/158] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:51 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:51.630568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-606ef43a-11ca-4c37-a908-e01e8606ca2e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.467984 May 27 03:24:51.631218 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 74/159] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:51 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:51.640065 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:51.640615 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:51.647483 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.648169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.648939 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.649974 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.673054 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lazy-loading 'flavor' on Instance uuid 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:24:51.781543 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-f27e0ec2-c988-4d84-86ef-5d09f4f0a1c1 req-e01474b7-e630-4b66-a40f-effcd7ded4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668956ce-1a9e-43d1-a8d9-6ed759ad30f3", "tag": "906f93e1-97e9-4418-8ad2-066ad5cfe98a"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:51.800940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f27e0ec2-c988-4d84-86ef-5d09f4f0a1c1 req-e01474b7-e630-4b66-a40f-effcd7ded4d3 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.801718 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f27e0ec2-c988-4d84-86ef-5d09f4f0a1c1 req-e01474b7-e630-4b66-a40f-effcd7ded4d3 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.816338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cb14f9b0-6117-4baa-8f62-cbbd1911a0c4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f/action" status: 200 len: 32 microversion: 2.1 time: 0.180801 May 27 03:24:51.817621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 86/160] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:24:51 2022] POST /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:24:51.827688 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:51.828873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:51.837960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.838259 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-f27e0ec2-c988-4d84-86ef-5d09f4f0a1c1 req-e01474b7-e630-4b66-a40f-effcd7ded4d3 service nova] Creating event network-changed:906f93e1-97e9-4418-8ad2-066ad5cfe98a for instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 on hv-cinder-82880 May 27 03:24:51.838965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.840305 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.841370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.843140 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-f27e0ec2-c988-4d84-86ef-5d09f4f0a1c1 req-e01474b7-e630-4b66-a40f-effcd7ded4d3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066610 May 27 03:24:51.844098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 75/161] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:24:52.028266 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:52.041415 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6c9418b2-f193-4a8a-a1d5-5f1a24478354 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.217129 May 27 03:24:52.049070 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 87/162] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:51 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:52.659959 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:52.661435 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:52.691171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:52.691684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:52.692510 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:52.699214 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:53.059710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:53.060406 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:53.081903 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:53.082718 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:53.084040 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:53.084508 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:53.101679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:53.116580 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f539f258-eb03-42f1-8da5-643af2dd0fee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1363 microversion: 2.1 time: 0.469629 May 27 03:24:53.120227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 76/163] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:52 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:53.271475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:53.282867 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a7255748-52d5-414c-9c7e-1b993161a2ae tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.227784 May 27 03:24:53.283763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 88/164] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:53 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:54.134611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:54.135215 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:54.148322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.148771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.150079 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.150510 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.300606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:54.301211 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:54.308914 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.312377 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.313353 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.313790 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.543734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:54.555175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c73078ab-4873-4cab-bbe3-f7bfeb30b458 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.255509 May 27 03:24:54.557907 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 89/165] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:54 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:54.657082 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:54.676940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c67927c1-0335-4021-b2a7-8e0ddf87578c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1548 microversion: 2.1 time: 0.545554 May 27 03:24:54.681745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 77/166] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:54 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1548 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:54.703722 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2fe76e7a-312e-4249-b8f6-4c19e2fe22c9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:54.704251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2fe76e7a-312e-4249-b8f6-4c19e2fe22c9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:54.719510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe76e7a-312e-4249-b8f6-4c19e2fe22c9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.720001 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe76e7a-312e-4249-b8f6-4c19e2fe22c9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.720789 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe76e7a-312e-4249-b8f6-4c19e2fe22c9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.721223 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe76e7a-312e-4249-b8f6-4c19e2fe22c9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.870130 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2fe76e7a-312e-4249-b8f6-4c19e2fe22c9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172956 May 27 03:24:54.870716 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 90/167] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:24:54 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:55.589451 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:55.593716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:55.608424 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:55.609069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:55.610194 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:55.611937 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:55.982592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:55.991254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ee326903-2606-44bb-b32f-4960f63aaab7 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.419919 May 27 03:24:56.003658 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 78/168] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:55 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:56.865535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-3c1125a4-005d-4aaf-bef2-c68611b26152 req-72b4c5c9-5b4f-404a-9948-644470ec5188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a8db13-6978-4562-918e-29f8ca94ef3f", "tag": "5f209ba7-5949-4139-a03b-ee0ae3138cea"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:56.880265 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3c1125a4-005d-4aaf-bef2-c68611b26152 req-72b4c5c9-5b4f-404a-9948-644470ec5188 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:56.881099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3c1125a4-005d-4aaf-bef2-c68611b26152 req-72b4c5c9-5b4f-404a-9948-644470ec5188 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:56.896921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-3c1125a4-005d-4aaf-bef2-c68611b26152 req-72b4c5c9-5b4f-404a-9948-644470ec5188 service nova] Creating event network-changed:5f209ba7-5949-4139-a03b-ee0ae3138cea for instance 15a8db13-6978-4562-918e-29f8ca94ef3f on hv-cinder-82880 May 27 03:24:56.926903 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-3c1125a4-005d-4aaf-bef2-c68611b26152 req-72b4c5c9-5b4f-404a-9948-644470ec5188 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068592 May 27 03:24:56.931955 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 91/169] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:57.013588 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:57.013588 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:57.029341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:57.029997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:57.031467 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:57.032158 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:57.215451 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:57.225417 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-82747c63-7200-4362-acac-d56627d9d305 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.219226 May 27 03:24:57.226390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 79/170] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:57 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:58.245629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:58.246847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:58.255107 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:58.255769 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:58.256650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:58.257183 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:58.450718 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:58.460636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f191b3f9-52e8-4013-b1bf-3a6b1b63e950 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.221473 May 27 03:24:58.462618 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 92/171] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:58 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:59.483196 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:59.484006 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:59.495305 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:59.496476 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:59.499508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:59.500059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:59.632047 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:59.640098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-24ee12c1-a43e-4043-a4ba-188e277b7f7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.165760 May 27 03:24:59.640662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 80/172] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:24:59 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:00.668303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:00.668945 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:00.682855 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.683517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:00.684691 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.690745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:00.693017 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:00.696598 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:00.713902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.714357 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:00.715132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.715625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:00.753551 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:25:00.772877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:00.900376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3a7fe8a6-5590-42b8-a335-6ca529d46175 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "DELETE /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 204 len: 0 microversion: 2.1 time: 0.213450 May 27 03:25:00.901069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:00.901279 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 81/173] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:25:00 2022] DELETE /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:25:00.910417 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-396ac564-aa03-4761-b537-3fd94c130cec tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.256383 May 27 03:25:00.910893 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:00.911004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 93/174] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:00 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:00.912006 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:00.919302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.919751 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:00.920551 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.920986 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:01.060926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:01.070616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-453dd3ff-4347-44aa-801e-df5e086209cf tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1554 microversion: 2.1 time: 0.164906 May 27 03:25:01.071179 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 82/175] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:00 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:01.928663 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:01.929189 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:01.936289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:01.937004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:01.937934 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:01.938723 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:02.073075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:02.080935 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d8ee3468-9caa-45a2-936d-d13956868bbd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.156586 May 27 03:25:02.091439 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:02.092213 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:02.096290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 94/176] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:01 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:02.110722 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:02.111340 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:02.112131 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:02.112590 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:02.265495 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:02.274043 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-edf17ced-58f3-438c-8f81-40ba7cd11cf8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1554 microversion: 2.1 time: 0.189576 May 27 03:25:02.279993 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 83/177] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:02 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:03.113196 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:03.113834 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:03.120157 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:03.120603 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:03.121563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:03.121995 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:03.260631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:03.277753 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6c027a96-318d-43ac-8d65-81e553f20f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.168334 May 27 03:25:03.278346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 95/178] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:03 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:03.293756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:03.296542 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:03.305342 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:03.305783 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:03.307088 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:03.307521 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:03.483899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:03.493459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4490b89c-009b-47c0-8617-07a61b3502fb tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1554 microversion: 2.1 time: 0.206613 May 27 03:25:03.494476 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 84/179] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:03 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:04.295457 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:04.295971 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:04.301800 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:04.302239 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:04.302982 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:04.303411 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:04.452628 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:04.460403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cff9cdf1-7ee9-458b-9804-42fa49ebae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.169422 May 27 03:25:04.461003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 96/180] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:04 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:04.510321 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:04.510941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:04.517901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:04.518335 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:04.519078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:04.519501 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:04.652830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:04.661794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7b57a139-4016-406a-a773-05b71e77c5cd tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1554 microversion: 2.1 time: 0.155354 May 27 03:25:04.662369 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 85/181] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:04 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:05.478101 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:05.478807 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:05.485720 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:05.486263 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:05.487100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:05.487536 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:05.634002 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:05.641803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-99197a1b-469f-4e54-80c6-6f2d3d0a00b0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.168562 May 27 03:25:05.642461 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 97/182] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:05 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:05.678475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:05.679086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:05.685359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:05.685853 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:05.686803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:05.687235 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:05.835323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:05.846113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5979cd6f-3673-417f-a4a0-5d07d0f3a2f8 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1554 microversion: 2.1 time: 0.171431 May 27 03:25:05.846679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 86/183] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:05 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:06.659687 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:06.661136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:06.669728 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:06.670370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:06.671451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:06.672119 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:06.767435 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-f8d7c82a-78c0-4e17-84ab-b1e7d2d0d8df req-9a169e29-6ba7-474a-a538-11ddc041b5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044c7e01-8c46-4677-b931-aee2526ef362", "name": "network-vif-deleted", "tag": "502ea12a-9820-4987-ba82-9d6c8aa95993"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:06.778512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f8d7c82a-78c0-4e17-84ab-b1e7d2d0d8df req-9a169e29-6ba7-474a-a538-11ddc041b5a6 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:06.779057 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f8d7c82a-78c0-4e17-84ab-b1e7d2d0d8df req-9a169e29-6ba7-474a-a538-11ddc041b5a6 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:06.792900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-f8d7c82a-78c0-4e17-84ab-b1e7d2d0d8df req-9a169e29-6ba7-474a-a538-11ddc041b5a6 service nova] Creating event network-vif-deleted:502ea12a-9820-4987-ba82-9d6c8aa95993 for instance 044c7e01-8c46-4677-b931-aee2526ef362 on hv-cinder-82880 May 27 03:25:06.799535 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-f8d7c82a-78c0-4e17-84ab-b1e7d2d0d8df req-9a169e29-6ba7-474a-a538-11ddc041b5a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040643 May 27 03:25:06.800396 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 87/184] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:25:06.865618 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:06.866232 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:06.873303 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:06.873781 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:06.874536 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:06.874967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:06.878207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:06.888156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8fd9f063-16e9-46ca-9264-75bd2197954f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.232424 May 27 03:25:06.891660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 98/185] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:06 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:06.949574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:06.959494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-605b5291-2b01-40a2-a408-66e3151731ff tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1512 microversion: 2.1 time: 0.098824 May 27 03:25:06.960029 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 88/186] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:06 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:07.905684 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:07.906806 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:07.913221 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.913938 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:07.914712 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.915101 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:07.976819 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:07.977661 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:07.984168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.984688 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:07.985450 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.985878 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:08.054495 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:08.063022 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-17bbdc73-144d-43a3-9ff6-60cb5af63294 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1346 microversion: 2.1 time: 0.090170 May 27 03:25:08.063597 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 89/187] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:07 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:08.116194 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:08.124100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-49183420-9ed1-4267-8188-36d121acc922 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.222426 May 27 03:25:08.124742 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 99/188] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:07 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:09.081511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:09.082131 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:09.088619 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:09.089061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:09.089752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:09.090173 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:09.142359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:09.142950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:09.149192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:09.149632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:09.150388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:09.150815 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:09.162211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:09.166496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:09.181228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e8e576b4-c81e-47fe-8b42-fbe1d6dc9184 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1346 microversion: 2.1 time: 0.103879 May 27 03:25:09.181820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 90/189] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:09 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:09.298331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:09.306643 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-722a618f-1f43-4555-9934-5b533b8133a0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.168009 May 27 03:25:09.307302 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 100/190] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:09 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:10.198938 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:10.199707 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:10.207485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:10.207970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:10.208831 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:10.209418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:10.246060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:10.246516 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:10.247109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lazy-loading 'fault' on Instance uuid 044c7e01-8c46-4677-b931-aee2526ef362 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:25:10.310622 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d835d78d4f4b019ced356585af16c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1626e5c02845f5b9b93e8b5fe916f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:10.319128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-cafcca89-1c4f-456f-b8e3-415a6cb71fc2 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 200 len: 1351 microversion: 2.1 time: 0.124339 May 27 03:25:10.319987 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 91/191] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:10 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:10.323505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:10.324155 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:10.330726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:10.331341 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:10.332392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:10.332997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:10.463057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:10.470646 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d299fae6-d55d-4854-9eca-963d2d53d47c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.151219 May 27 03:25:10.471213 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 101/192] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:10 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:11.335975 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:11.336533 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:11.343211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.343659 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.346779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.347227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.360863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] HTTP exception thrown: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Request method failure captured: May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 HTTP/1.1 May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERLROcFNKIRXPmzTRmRpC9xkUtQsw0A_Z7XmhJ0SsMmcwKHn7cRNDEE3sDe1ercFtGi9SE-e3lvlxYCm1rN9kmLYWuFGL9GepjkSHaY7Nmsl60Z7Fioy8x0HFxre4l1aLvBAglqwXEwyu4Tg2E5On9xnreBdWze7NFJZcwDcxcMpcw May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:25:11.365511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}] May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: e4d835d78d4f4b019ced356585af16c7 May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.367581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '044c7e01-8c46-4677-b931-aee2526ef362'} May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:25:11.368433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.369803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:11.371013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Returning 404 to user: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:25:11.371013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-65854708-7d76-4ba8-b842-43fc43c72b10 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 404 len: 111 microversion: 2.1 time: 0.035035 May 27 03:25:11.371013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 92/193] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:11 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:25:11.478176 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:11.479102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:11.485578 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.486013 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.486765 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.487190 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.491553 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:11.492604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:11.500559 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.501006 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.501760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.502186 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.503114 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] HTTP exception thrown: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Request method failure captured: May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362/os-volume_attachments HTTP/1.1 May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERLROcFNKIRXPmzTRmRpC9xkUtQsw0A_Z7XmhJ0SsMmcwKHn7cRNDEE3sDe1ercFtGi9SE-e3lvlxYCm1rN9kmLYWuFGL9GepjkSHaY7Nmsl60Z7Fioy8x0HFxre4l1aLvBAglqwXEwyu4Tg2E5On9xnreBdWze7NFJZcwDcxcMpcw May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:25:11.508232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}] May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: e4d835d78d4f4b019ced356585af16c7 May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.509714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'server_id': '044c7e01-8c46-4677-b931-aee2526ef362'} May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:25:11.510498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:11.511785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:11.513300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Returning 404 to user: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:25:11.513300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-15cd9574-c4f3-4dc1-9ecb-8bdc548a1a32 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037168 May 27 03:25:11.513300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 102/194] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:25:11 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:25:11.653484 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:11.660987 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-99077910-ceda-4336-8d35-4ead481a9f25 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.176994 May 27 03:25:11.661552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 93/195] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:11 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:12.678057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:12.678673 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:12.680761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=60 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:12.686498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:12.687560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:12.687945 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:12.688374 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:12.817936 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:12.825909 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8a398616-9077-4482-a8fb-85454617c8ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.151659 May 27 03:25:12.826474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 103/196] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:12 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:13.842396 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:13.842900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:13.849596 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:13.850024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:13.850775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:13.851203 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:13.994300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:14.001701 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4811470f-e8eb-4a6c-afa8-d13c14ab187c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.163159 May 27 03:25:14.002443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 94/197] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:13 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:14.809479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:14.809956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:14.816281 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:14.816729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:14.817491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:14.817922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:14.832065 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] HTTP exception thrown: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Request method failure captured: May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: DELETE /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 HTTP/1.1 May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERLROcFNKIRXPmzTRmRpC9xkUtQsw0A_Z7XmhJ0SsMmcwKHn7cRNDEE3sDe1ercFtGi9SE-e3lvlxYCm1rN9kmLYWuFGL9GepjkSHaY7Nmsl60Z7Fioy8x0HFxre4l1aLvBAglqwXEwyu4Tg2E5On9xnreBdWze7NFJZcwDcxcMpcw May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:25:14.834200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}] May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: e4d835d78d4f4b019ced356585af16c7 May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.836180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '044c7e01-8c46-4677-b931-aee2526ef362'} May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:25:14.836962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.838681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:25:14.840019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Returning 404 to user: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:25:14.840019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8f0cbc59-93a2-4feb-af29-7f9e34553d37 tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "DELETE /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 404 len: 111 microversion: 2.1 time: 0.030023 May 27 03:25:14.840019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 104/198] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:25:14 2022] DELETE /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:25:14.845190 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:14.845795 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] [instance: 044c7e01-8c46-4677-b931-aee2526ef362] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:14.852260 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:14.852709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:14.853470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:14.853901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:14.867369 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] HTTP exception thrown: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Request method failure captured: May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 HTTP/1.1 May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERLROcFNKIRXPmzTRmRpC9xkUtQsw0A_Z7XmhJ0SsMmcwKHn7cRNDEE3sDe1ercFtGi9SE-e3lvlxYCm1rN9kmLYWuFGL9GepjkSHaY7Nmsl60Z7Fioy8x0HFxre4l1aLvBAglqwXEwyu4Tg2E5On9xnreBdWze7NFJZcwDcxcMpcw May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:25:14.868898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de1626e5c02845f5b9b93e8b5fe916f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de1626e5c02845f5b9b93e8b5fe916f0"}]}] May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: de1626e5c02845f5b9b93e8b5fe916f0 May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-DeleteServersTestJSON-1638208057 May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: e4d835d78d4f4b019ced356585af16c7 May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-DeleteServersTestJSON-1638208057-project May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.870296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '044c7e01-8c46-4677-b931-aee2526ef362'} May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:25:14.874225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. May 27 03:25:14.875601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:25:14.876849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] Returning 404 to user: Instance 044c7e01-8c46-4677-b931-aee2526ef362 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:25:14.876849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d56e8b19-75a4-4fd3-8d75-4283d2ce926b tempest-DeleteServersTestJSON-1638208057 tempest-DeleteServersTestJSON-1638208057-project] 10.222.0.62 "GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362" status: 404 len: 111 microversion: 2.1 time: 0.028823 May 27 03:25:14.876849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 95/199] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:14 2022] GET /compute/v2.1/servers/044c7e01-8c46-4677-b931-aee2526ef362 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:25:15.030745 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:15.030745 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:15.031607 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:15.033076 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:15.034064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:15.034570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:15.247918 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:15.273078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-553242a1-f303-4757-a8d9-65adc2729c7c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.255986 May 27 03:25:15.274050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 105/200] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:15 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:16.296235 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:16.297204 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:16.309558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:16.310072 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:16.311224 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:16.312754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:16.721865 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:16.731916 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b9262c4d-6a50-45f9-bb51-59f81698620a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.442290 May 27 03:25:16.732800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 96/201] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:16 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:17.750843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:17.751422 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:17.758189 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:17.758853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:17.759630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:17.760083 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:17.927562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:17.942200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f3c940f0-f209-41f9-9f47-77d97af1f382 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.196597 May 27 03:25:17.942856 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 106/202] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:17 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:18.959378 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:18.960846 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:18.968674 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:18.969304 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:18.970100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:18.970951 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:19.118107 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:19.126808 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-529b4e05-1eec-48d4-825d-fb1522e173ca tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.171376 May 27 03:25:19.127499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 97/203] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:18 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:20.144611 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:20.145345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:20.151624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.152173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.152926 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.153356 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.330695 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:20.339974 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3a22d5ba-5fb6-447b-8e45-d12b64fc5531 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.199471 May 27 03:25:20.340701 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 107/204] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:20 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:21.356428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:21.357027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:21.359432 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:21.364712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.365150 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:21.365891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.366322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:21.496838 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:21.500254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:21.505044 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-da9e5867-b969-4f4e-b169-7cdbfb0b0017 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.152379 May 27 03:25:21.505607 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 98/205] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:21 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:22.521630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:22.522853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:22.528877 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:22.529323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:22.530066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:22.530492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:22.680727 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:22.688799 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-02944cd3-2c6f-4530-b281-30d1626dae13 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.170963 May 27 03:25:22.689474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 108/206] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:22 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:23.706452 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:23.708289 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:23.716991 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.717648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.718663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.719637 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.948319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:23.958228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-afd8ca0a-989d-4745-b917-0299c1f9c1aa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.256221 May 27 03:25:23.958826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 99/207] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:23 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:24.977194 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:24.978263 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:24.984506 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.985090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:24.985987 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.986453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.230868 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:25.238895 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-822d92de-7e37-4705-9102-b6a4c3c9002b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.266467 May 27 03:25:25.240004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 109/208] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:24 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:26.257909 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:26.259357 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:26.267496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.268109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.269629 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.270297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.444592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:26.455336 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9ae61e9b-c632-455a-8b95-e337febb40bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.201726 May 27 03:25:26.456175 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 100/209] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:26 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:27.473271 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:27.474434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:27.484782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.485849 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.487373 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.488230 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.647180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:27.657097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-301949c2-cf6e-47ad-aa3b-994a387a7c43 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.187611 May 27 03:25:27.657667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 110/210] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:27 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:28.674374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:28.674971 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:28.683294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.683733 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.684504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.685012 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.817148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:28.825297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ffdc669b-4417-40f0-8e88-dce2f425ae33 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.154702 May 27 03:25:28.825856 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 101/211] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:28 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:29.842311 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:29.843874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:29.852589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:29.852589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:29.852589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:29.852589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.001308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:30.010685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-af444d9c-63dc-4497-8abc-c2019b3c8646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.172371 May 27 03:25:30.011382 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 111/212] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:29 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:31.028237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:31.028834 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:31.035257 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.035698 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.036485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.036911 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.172875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:31.180730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b45e7bd0-e523-4456-9b71-6d9c00fad48c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.156355 May 27 03:25:31.181616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 102/213] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:31 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:32.198491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:32.199131 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:32.205431 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:32.205883 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:32.206651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:32.207088 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:32.412918 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:32.421074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f1e7452b-b6f2-4cee-89dc-b09cf6d68913 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.226406 May 27 03:25:32.421581 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 112/214] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:32 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:33.438386 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:33.438930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:33.445319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:33.445760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:33.446528 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:33.446939 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:33.575054 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:33.582766 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-633cc8ca-8062-4bf8-82f2-0f61f8c9f0e1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.148287 May 27 03:25:33.583359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 103/215] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:33 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:34.599531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:34.600299 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:34.606368 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.606808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.607564 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.608017 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.756648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:34.765115 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-eb1b087f-d377-44d5-a2c9-31bd51a0c9d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.169578 May 27 03:25:34.765670 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 113/216] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:34 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:35.782020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:35.782545 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:35.788801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.789247 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.790040 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.790475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.936745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:35.949376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8bbc4159-ab26-410f-a151-e9a9552a9b6e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.171217 May 27 03:25:35.950687 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 104/217] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:35 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:36.967338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:36.967998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:36.973902 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.974347 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:36.975660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.976110 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.106705 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.116109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8bd1c883-0bcf-48f6-b2e2-b8ffab8e8131 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.152385 May 27 03:25:37.116985 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 114/218] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:36 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:37.433490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-487337890", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "networks": [{"uuid": "1d757b8e-3c2c-4d66-84a9-f19b199440d3"}]}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:37.483584 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] validate_networks() for [('1d757b8e-3c2c-4d66-84a9-f19b199440d3', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:25:37.831482 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:25:37.831928 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:25:37.832405 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:25:37.832799 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:25:37.833200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:25:37.845045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.845398 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.846178 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.846606 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.862627 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Getting quotas for project aee9b49e32b848e2a75facdeef1aa8a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:25:37.866938 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Getting quotas for user 8b9bfcb74bc14e92b96e4169ed323399 and project aee9b49e32b848e2a75facdeef1aa8a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:25:37.877470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:25:37.879729 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:25:37.925902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-574cbbc2-efb3-418c-a607-572fd6ed153e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496262 May 27 03:25:37.926909 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 105/219] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:25:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:25:37.938762 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ffa8b006-2182-4ba7-b70b-f7297c66b914 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:37.939435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ffa8b006-2182-4ba7-b70b-f7297c66b914 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:37.995867 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ffa8b006-2182-4ba7-b70b-f7297c66b914 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.002636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ffa8b006-2182-4ba7-b70b-f7297c66b914 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1218 microversion: 2.1 time: 0.068841 May 27 03:25:38.003092 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 115/220] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:37 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:38.133196 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:38.133795 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:38.140589 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.141043 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.141924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.142584 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.303474 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.313205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b023ee90-caf3-452d-b662-4033c479848f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1522 microversion: 2.1 time: 0.184341 May 27 03:25:38.313827 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 106/221] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:38 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:39.019918 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.020516 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.027024 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.027461 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.028249 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.028675 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.088370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.095669 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e553ae2c-1f63-4e8d-afe3-f8112ce0d02e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1270 microversion: 2.1 time: 0.079722 May 27 03:25:39.096259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 116/222] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:39.330544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.331285 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.337992 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.338441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.339194 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.339626 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.539125 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.546577 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e941acfd-bb3c-47fe-8c8f-1d3a0d9ad46b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1502 microversion: 2.1 time: 0.220501 May 27 03:25:39.547144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 107/223] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:39.562852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.563460 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.569505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.569953 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.570709 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.571145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.575019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=86 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:39.698204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.705944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-613bb340-0940-4d61-9249-7709e7564220 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1515 microversion: 2.1 time: 0.146799 May 27 03:25:39.706495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 117/224] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:40.114758 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:40.116082 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:40.127029 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.127480 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.128287 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.128713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.358699 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:40.366691 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9176a604-9abc-4c0d-a540-8898ddce5a9e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.256524 May 27 03:25:40.367259 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 108/225] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:40 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:41.005296 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-9bfc92bd-0ff4-4a86-bcdf-7c2493d65aa7 req-d4cefbcf-fdf8-42d8-b1c0-6ca5509ef18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2466e9b1-1269-4e12-b60a-3ada2d5b5448", "tag": "3241390e-ae71-4f08-8375-de655134e942"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:41.013507 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-9bfc92bd-0ff4-4a86-bcdf-7c2493d65aa7 req-d4cefbcf-fdf8-42d8-b1c0-6ca5509ef18b service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.013979 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-9bfc92bd-0ff4-4a86-bcdf-7c2493d65aa7 req-d4cefbcf-fdf8-42d8-b1c0-6ca5509ef18b service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.026467 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-9bfc92bd-0ff4-4a86-bcdf-7c2493d65aa7 req-d4cefbcf-fdf8-42d8-b1c0-6ca5509ef18b service nova] Creating event network-changed:3241390e-ae71-4f08-8375-de655134e942 for instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 on hv-cinder-82880 May 27 03:25:41.031949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-9bfc92bd-0ff4-4a86-bcdf-7c2493d65aa7 req-d4cefbcf-fdf8-42d8-b1c0-6ca5509ef18b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030138 May 27 03:25:41.033011 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 118/226] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:41.382420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:41.383062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:41.389794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.390242 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.390997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.391429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.525614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.533171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-24af9c3d-dfbb-4e1b-b1af-b3c5194e82f0 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.154588 May 27 03:25:41.533744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 109/227] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:41 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:42.551172 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:42.551777 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:42.558075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.558519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.559274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.559705 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.697298 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:42.707471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a389a68b-d5fb-47f2-b803-bdf1ec85179b tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.160455 May 27 03:25:42.708255 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 119/228] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:42 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:43.725437 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:43.725978 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:43.733623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.734241 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.735095 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.735602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.945890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.953475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-53b0952b-af8d-4e4a-8022-ecdd257ab4dd tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.232303 May 27 03:25:43.954035 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 110/229] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:43 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:44.284678 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:44.285667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:44.287584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=36 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:44.294144 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.294596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.295441 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.296004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.322851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lazy-loading 'flavor' on Instance uuid 66633a35-54c4-43cf-9173-307af9be25ed {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:25:44.405547 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-63160db4-6a23-42b0-82fe-f34c66c37385 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed/action" status: 200 len: 32 microversion: 2.1 time: 0.124707 May 27 03:25:44.406321 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 120/230] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:25:44 2022] POST /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:25:44.416814 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:44.417553 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:44.423959 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.424442 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.425300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.425729 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.756552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:44.764004 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-72ec6b4b-276c-4ad2-9492-339943dd8651 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.350864 May 27 03:25:44.764564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 111/231] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:44 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:44.970987 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:44.971680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:44.978434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.978874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.979615 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.980071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.114526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.123491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-426ac789-b2ba-4676-9f93-bb76514568c3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.156674 May 27 03:25:45.124102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 121/232] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:44 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:45.780948 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:45.781549 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:45.788633 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.789077 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.789822 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.790252 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.926166 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.933825 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5845e2a1-a66b-40ca-9beb-792220651b7e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.156665 May 27 03:25:45.934395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 112/233] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:45 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:46.139899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:46.140439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:46.146998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.147443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.148221 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.148655 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.278834 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:46.286776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-01dd1172-0d88-49b4-b42a-1cadeb1bed83 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.150785 May 27 03:25:46.287379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 122/234] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:46 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:46.953901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:46.954497 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:46.960988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.961429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.962177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.962604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.090300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.097623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8364a238-7905-4f53-9cc5-fae28f88cc72 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.148490 May 27 03:25:47.098176 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 113/235] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:46 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:47.304963 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:47.305403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:47.311611 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.312116 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.312864 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.313316 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.449269 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.458734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-03780d5f-8953-491a-980c-0efd278e7325 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.157273 May 27 03:25:47.459302 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 123/236] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:47 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:48.114978 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:48.115572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:48.117426 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:48.118225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:48.118846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-aa9a7435-da90-4fe5-931f-4fd6467cb20f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:48.119405 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-aa9a7435-da90-4fe5-931f-4fd6467cb20f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:48.121929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:48.124932 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.125375 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.126133 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.126561 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.127793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aa9a7435-da90-4fe5-931f-4fd6467cb20f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.128400 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aa9a7435-da90-4fe5-931f-4fd6467cb20f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.129367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aa9a7435-da90-4fe5-931f-4fd6467cb20f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.129801 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aa9a7435-da90-4fe5-931f-4fd6467cb20f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.156930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-aa9a7435-da90-4fe5-931f-4fd6467cb20f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/ips" status: 200 len: 151 microversion: 2.20 time: 0.042752 May 27 03:25:48.163453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 124/237] 10.222.0.62 () {60 vars in 1288 bytes} [Fri May 27 03:25:48 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:25:48.260162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.268595 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c9d70e37-7bb0-4e22-b65e-9be0d21838bb tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.158020 May 27 03:25:48.270100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 114/238] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:48 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:48.476166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:48.476755 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:48.488250 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.491000 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.491959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.492492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.693158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.700619 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-673ec15c-5eba-4959-b6a1-7a830e72d879 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.229249 May 27 03:25:48.701175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 125/239] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:48 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:49.286523 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:49.287255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:49.297068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.297520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.298286 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.298724 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.356406 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-efbef352-2c0f-4d24-b6c7-5eec8ca11d8b req-01db2bc7-6c7f-4e36-bb7c-29d374478b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2466e9b1-1269-4e12-b60a-3ada2d5b5448", "name": "network-vif-plugged", "status": "completed", "tag": "3241390e-ae71-4f08-8375-de655134e942"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:49.375869 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-efbef352-2c0f-4d24-b6c7-5eec8ca11d8b req-01db2bc7-6c7f-4e36-bb7c-29d374478b30 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.375869 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-efbef352-2c0f-4d24-b6c7-5eec8ca11d8b req-01db2bc7-6c7f-4e36-bb7c-29d374478b30 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.394936 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-efbef352-2c0f-4d24-b6c7-5eec8ca11d8b req-01db2bc7-6c7f-4e36-bb7c-29d374478b30 service nova] Creating event network-vif-plugged:3241390e-ae71-4f08-8375-de655134e942 for instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 on hv-cinder-82880 May 27 03:25:49.401714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-efbef352-2c0f-4d24-b6c7-5eec8ca11d8b req-01db2bc7-6c7f-4e36-bb7c-29d374478b30 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047908 May 27 03:25:49.402708 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 126/240] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:25:49.463593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.471445 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-daed126b-8ec6-40be-9ed6-b955177f3100 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.188927 May 27 03:25:49.472052 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 115/241] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:49 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:49.718058 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:49.719325 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:49.725461 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.725906 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.726664 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.727094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.863972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.872174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b8f8a096-03d2-4d2a-9f03-de3419cdd5df tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.158263 May 27 03:25:49.872794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 127/242] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:49 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:50.487849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.488451 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.495085 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.495529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.496331 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.496759 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.501896 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:50.506472 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:50.507398 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.514273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.515289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.516234 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.516843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.547320 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lazy-loading 'flavor' on Instance uuid 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:25:50.643967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.653265 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-12199160-8935-469c-bc9b-5373e096e90b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.169182 May 27 03:25:50.653997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 116/243] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:50.829947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-14d78dab-87fe-4fb9-ae65-9fb3c96bb08f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/action" status: 202 len: 0 microversion: 2.20 time: 0.327476 May 27 03:25:50.835547 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 128/244] 10.222.0.62 () {62 vars in 1318 bytes} [Fri May 27 03:25:50 2022] POST /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:25:50.841925 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.842708 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.849242 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.850104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.850904 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.851356 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.894309 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.895123 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.903356 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.903808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.904610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.905211 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.015363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.026745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.028289 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.029642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-38682bb4-2134-42c0-951e-052d8cf403bd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.192486 May 27 03:25:51.036225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 117/245] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:51.107957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.115986 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d7a14ee5-5b8d-4f38-adc1-6e6be2c4e964 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1318 microversion: 2.1 time: 0.226982 May 27 03:25:51.116549 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 129/246] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:51.669854 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:51.670459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:51.672794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:51.679539 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.680094 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.680856 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.681289 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.818822 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.826440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5255833f-763a-4ab2-ad4d-cbd3dbf19eb5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.160378 May 27 03:25:51.827021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 118/247] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:51 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:52.048237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:52.048836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:52.055430 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.055777 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.056563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.056997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.135572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:52.136206 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:52.142192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.142630 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.143436 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.143898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.196498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.204950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.206500 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.207648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f77783da-1dcf-4f1e-898a-b1a06f36dc10 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.163265 May 27 03:25:52.208285 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 130/248] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:52 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:52.277878 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.285274 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-df3e42bf-ae88-48f8-bfea-fd70178ed5ea tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1506 microversion: 2.1 time: 0.153466 May 27 03:25:52.285835 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 119/249] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:52 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:52.696309 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-05cc2fa2-a417-4e15-8dc2-7c8bf8bba631 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:52.697101 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-05cc2fa2-a417-4e15-8dc2-7c8bf8bba631 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:52.703646 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc2fa2-a417-4e15-8dc2-7c8bf8bba631 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.705033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc2fa2-a417-4e15-8dc2-7c8bf8bba631 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.706022 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc2fa2-a417-4e15-8dc2-7c8bf8bba631 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.706681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc2fa2-a417-4e15-8dc2-7c8bf8bba631 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.725280 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:52.745055 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-05cc2fa2-a417-4e15-8dc2-7c8bf8bba631 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/ips" status: 200 len: 145 microversion: 2.1 time: 0.047241 May 27 03:25:52.745055 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 131/250] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:25:52 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:52.843625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:52.844262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:52.850736 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.851180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.851960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.852392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.988659 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.997616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-834ab51d-d2eb-446f-ae70-0991f9b5b179 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.157690 May 27 03:25:52.998187 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 120/251] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:52 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:53.226211 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:53.226839 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:53.233471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.233918 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.234761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.235253 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.363535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.371836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.373349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.374505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e5be5985-21d1-4868-9dc5-dd656cbb7978 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.152691 May 27 03:25:53.375061 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 132/252] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:53 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:54.014489 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.015107 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:54.022660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.023122 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.023955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.024394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.159364 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.167039 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a9e8c1d8-c1fe-4790-b2ad-b20d302fb1f4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.156356 May 27 03:25:54.167610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 121/253] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:54.392464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.393665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:54.401018 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.401472 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.402242 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.402675 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.533454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.541880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.543384 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.544561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c27a5626-9463-476a-9232-a407d58bed04 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.156020 May 27 03:25:54.545121 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 133/254] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:55.184402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:55.185108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:55.191480 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.191970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.192730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.193161 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.322597 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:55.330417 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a11ba381-0631-483b-a9f8-3c1deeaf4893 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.149935 May 27 03:25:55.330981 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 122/255] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:55 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:55.562506 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:55.563195 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:55.570406 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.570892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.571740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.572240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.708144 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:55.716998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:55.718536 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:55.719699 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-81a0c36f-bb85-402e-a367-045730fda44e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.161235 May 27 03:25:55.720291 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 134/256] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:55 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:56.349075 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:56.349793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:56.356537 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.356982 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.357749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.358184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.490029 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.497475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-86df8e56-4920-49bb-b1fa-0a2790a041ef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.153086 May 27 03:25:56.498038 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 123/257] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:56 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:56.738226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:56.738975 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:56.745603 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.746356 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.747190 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.747802 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.930153 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.944616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.946139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.947299 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-86109fe6-6b2c-4d7b-b359-77297d517094 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.213042 May 27 03:25:56.947872 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 135/258] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:56 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:57.514985 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:57.515596 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:57.533037 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.535428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.537019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.537609 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.708763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:57.717255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0395dccd-81a0-4eea-a47a-d1ee05a221f6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.206470 May 27 03:25:57.718359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 124/259] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:57 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:57.922021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-807f6c1c-3bc3-4a5f-9794-0fb346d80baa tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ea23c1c-da88-43f2-ae71-3909fd2ac4b9"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:57.923473 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-807f6c1c-3bc3-4a5f-9794-0fb346d80baa tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:57.929520 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-807f6c1c-3bc3-4a5f-9794-0fb346d80baa tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.929963 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-807f6c1c-3bc3-4a5f-9794-0fb346d80baa tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.930781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-807f6c1c-3bc3-4a5f-9794-0fb346d80baa tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.931210 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-807f6c1c-3bc3-4a5f-9794-0fb346d80baa tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.966423 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:57.967128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:57.975658 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.976135 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.976906 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.977340 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.135007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.143885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.146109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.147312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1d00fb60-8fc8-4b29-9b34-c50eeac0cbb0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.185087 May 27 03:25:58.147884 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 125/260] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:57 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:58.734690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:58.735386 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:58.742874 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.743356 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.744250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.744648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.925046 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.938645 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e88f3838-c172-4d08-b6b5-e3f90e5a2315 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.207610 May 27 03:25:58.939253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 126/261] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:58 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:59.166022 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:59.166738 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:59.173025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.173489 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.174319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.174813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.309576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.319487 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.321075 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.322369 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-770d5675-7806-4571-962e-ad51c9db466f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.160410 May 27 03:25:59.323113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 127/262] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:25:59 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:59.955727 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:59.956436 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:59.963270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.963864 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.964703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.965306 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.011729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-807f6c1c-3bc3-4a5f-9794-0fb346d80baa tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.093367 May 27 03:26:00.012520 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 136/263] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:25:57 2022] POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-volume_attachments => generated 194 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:00.125793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.140118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ab163743-c5bf-4a81-bb07-69437e8262f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.188321 May 27 03:26:00.140598 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 128/264] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:25:59 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:00.341517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:00.342239 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:00.349553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.349999 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.350755 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.351189 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.477548 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.485426 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.486940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.488118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-16628f15-c534-46ab-bd57-d1fe9790dfac tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.150858 May 27 03:26:00.488664 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 137/265] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:00 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:01.157244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:01.157848 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:01.164800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.165248 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.166011 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.166443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.295757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.303801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a3f3dc8b-09f2-48fd-9ae0-76c03cd81c3d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.150380 May 27 03:26:01.304382 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 129/266] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:01 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:01.506003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:01.507249 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:01.513971 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.514420 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.515192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.515624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.641860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.650269 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.651767 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.652952 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4cd3776e-12e7-4937-8fa1-1de2c9b396bb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.150956 May 27 03:26:01.653514 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 138/267] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:01 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:02.320589 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:02.321098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:02.328056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.328514 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.329279 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.329715 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.459585 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:02.467366 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9cd9675c-cc9d-489c-af99-46fbcbb05cb9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.151274 May 27 03:26:02.468266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 130/268] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:02 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:02.672002 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:02.672606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:02.679981 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.680429 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.681198 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.681632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.817294 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:02.825327 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:02.826833 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:02.828275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a11b9aa1-f3ed-4267-99b0-fb400dd3d406 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.160356 May 27 03:26:02.828832 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 139/269] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:02 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:03.484642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:03.485236 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:03.493052 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:03.493518 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:03.494271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:03.494867 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:03.633846 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:03.641188 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-89be4efc-4ed9-4ccd-b470-f9373d06d4f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.160942 May 27 03:26:03.641752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 131/270] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:03 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:03.846143 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:03.846748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:03.853800 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:03.854242 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:03.855003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:03.855435 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:03.991914 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.000313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.001809 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.002967 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ae4744a2-5430-46d8-991d-ddbd7258b20a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.160617 May 27 03:26:04.003518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 140/271] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:03 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:04.657722 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:04.658345 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:04.668756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.669493 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.670271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.670703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.819350 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.822839 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:04.829209 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1a4eee1e-b56b-4516-abc1-132a3df81464 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.175213 May 27 03:26:04.829875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 132/272] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:04 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:05.020491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:05.021086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:05.027506 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.027990 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.028761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.029191 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.172980 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:05.186133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:05.187877 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:05.189256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7d43c927-efda-4eb5-b439-991e404f95d0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.172729 May 27 03:26:05.191770 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 141/273] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:05 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:05.846965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:05.847482 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:05.854146 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.854822 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.855566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.856025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:06.070436 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.082436 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4d76a4f6-13ae-479c-8fb5-91aff881bb84 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.239794 May 27 03:26:06.086732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 133/274] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:05 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:06.210823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:06.211680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:06.218862 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:06.219312 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:06.220111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:06.220547 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:06.628307 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.637531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.640015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.641832 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ce22e9e3-be58-4333-a5b6-4087d289f52a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.435253 May 27 03:26:06.643184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 142/275] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:06 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:07.100566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:07.101931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:07.110976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.111470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.112518 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.113026 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.368450 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:07.376398 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ce690814-8da3-40ea-99e6-2f4b1c678e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.280840 May 27 03:26:07.377513 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 134/276] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:07 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:07.661807 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:07.663099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:07.670461 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.671084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.671963 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.672502 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.847906 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:07.857708 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:07.859226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:07.860610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-650b47a8-f91d-40a8-be46-2119ca767279 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.203331 May 27 03:26:07.861358 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 143/277] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:07 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:08.394682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:08.396328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:08.404362 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:08.405811 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:08.406938 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:08.408349 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:08.640048 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:08.648143 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a90bd2c7-33c9-479d-9364-91f033392d1a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.258171 May 27 03:26:08.648828 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 135/278] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:08 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:08.879213 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:08.879980 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:08.892417 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:08.893156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:08.896117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:08.898514 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.227124 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.239776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.242043 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.243563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ce2b6f5c-f85e-422d-8b4b-57857baa3038 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.368988 May 27 03:26:09.245072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 144/279] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:08 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:09.665596 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:09.666210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:09.672634 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:09.673283 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.674242 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:09.674836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.840352 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.848984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e9b89f6b-6bca-4a77-9ab3-a3dca6279e87 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.186606 May 27 03:26:09.855380 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 136/280] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:09 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:10.264056 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:10.264666 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:10.285431 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.285881 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:10.290118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.290632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:10.508163 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:10.525507 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:10.527008 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:10.536283 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b30f2e60-32cc-49e5-939b-aa05aadc279d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.268048 May 27 03:26:10.536937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 145/281] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:10 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:10.874801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:10.875414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:10.882573 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.883024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:10.883930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.884667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.144602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.154211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4f0df9b2-8d40-4628-8417-b5c104cf95d2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.286785 May 27 03:26:11.164353 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 137/282] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:10 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:11.559251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:11.560710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:11.571654 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:11.572672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.573889 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:11.574544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.783760 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.794523 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.796492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.798722 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-be841459-3bfe-43c3-93f1-1e12b6a1ff92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1744 microversion: 2.20 time: 0.247931 May 27 03:26:11.808898 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 146/283] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:11 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:11.866670 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-70b1148c-3131-4557-80cf-ce65d17df670 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:11.873240 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-70b1148c-3131-4557-80cf-ce65d17df670 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:11.873679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-70b1148c-3131-4557-80cf-ce65d17df670 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.942908 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-70b1148c-3131-4557-80cf-ce65d17df670 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Going to try to stop instance {{(pid=117609) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 03:26:12.015789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-70b1148c-3131-4557-80cf-ce65d17df670 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action" status: 202 len: 0 microversion: 2.1 time: 0.152820 May 27 03:26:12.017758 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 138/284] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:26:11 2022] POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:26:12.026255 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:12.027113 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:12.035388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.037175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.038723 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.039533 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.042747 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:12.172917 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:12.173916 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:12.182902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.183355 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.184244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.184697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.303485 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:12.313090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0a7da989-1882-46ad-abe9-9fbbf2c138e6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.290934 May 27 03:26:12.313983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 147/285] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:12 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:12.366786 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:12.392151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b15cc550-cdfb-48d6-8c57-38936198f1d5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.223964 May 27 03:26:12.392801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 139/286] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:12 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:12.829565 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:12.832499 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:12.843778 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.844901 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.845825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.846527 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.195217 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:13.207035 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:13.208907 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:13.210331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5aff35a1-aa83-47fe-9501-cbf4d4ab870a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1744 microversion: 2.20 time: 0.395322 May 27 03:26:13.211480 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 148/287] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:12 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1744 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:13.336607 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:13.338012 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:13.347328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:13.349040 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.350379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:13.351197 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.415442 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:13.416565 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:13.423941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:13.424387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.425558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:13.426759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.505880 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:13.514577 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-eaf6f2ed-6b14-4d5d-bdf5-4b4218bebe70 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.185772 May 27 03:26:13.523867 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 140/288] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:13 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:13.708119 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:13.718524 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-af3da746-f504-4afb-b804-35e6e2b5b4ed tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.311121 May 27 03:26:13.727898 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 149/289] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:13 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:13.992160 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-42fe60be-7c6b-4285-8b09-bd9a2fe5b47a req-b7e4c481-dd3c-4a2e-95c3-cbaee397c88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668956ce-1a9e-43d1-a8d9-6ed759ad30f3", "name": "network-vif-plugged", "status": "completed", "tag": "906f93e1-97e9-4418-8ad2-066ad5cfe98a"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:14.004629 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-42fe60be-7c6b-4285-8b09-bd9a2fe5b47a req-b7e4c481-dd3c-4a2e-95c3-cbaee397c88f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.006244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-42fe60be-7c6b-4285-8b09-bd9a2fe5b47a req-b7e4c481-dd3c-4a2e-95c3-cbaee397c88f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.022844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-42fe60be-7c6b-4285-8b09-bd9a2fe5b47a req-b7e4c481-dd3c-4a2e-95c3-cbaee397c88f service nova] Creating event network-vif-plugged:906f93e1-97e9-4418-8ad2-066ad5cfe98a for instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 on hv-cinder-82880 May 27 03:26:14.031530 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-42fe60be-7c6b-4285-8b09-bd9a2fe5b47a req-b7e4c481-dd3c-4a2e-95c3-cbaee397c88f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042892 May 27 03:26:14.034318 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 141/290] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:14.231742 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:14.233092 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:14.242062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.242784 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.243781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.244459 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.541001 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:14.556922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:14.557678 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.574936 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.576496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.577923 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-58e54440-4194-488c-acf4-7680bd096758 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1744 microversion: 2.20 time: 0.352067 May 27 03:26:14.578477 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 150/291] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:14 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1744 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:14.585313 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.594262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.595374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.598625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.742973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:14.747110 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:14.778100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=62 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:14.779853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.781846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.783430 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.793405 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.869320 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.885028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b335b0be-52dc-4f60-8373-a4e59fc00c22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.355321 May 27 03:26:14.886000 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 142/292] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:14 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:15.007563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:15.016092 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8c8f89ed-2e98-4681-9d19-28baf5d5602b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1501 microversion: 2.1 time: 0.278007 May 27 03:26:15.020206 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 151/293] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:14 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:15.038460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d02e21-5a90-4a75-a14b-91345335618a"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:15.039519 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:15.048774 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a8802462-b62a-48cd-9744-82892374c2d5 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99ccddd1-3a42-4201-b571-15c2574143e0", "device": "/dev/sdb"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:15.050510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a8802462-b62a-48cd-9744-82892374c2d5 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:15.051793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.052552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.058861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8802462-b62a-48cd-9744-82892374c2d5 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.059541 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8802462-b62a-48cd-9744-82892374c2d5 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.060265 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.060660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8802462-b62a-48cd-9744-82892374c2d5 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.060926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.061886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a8802462-b62a-48cd-9744-82892374c2d5 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.115084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] HTTP exception thrown: Cannot 'attach_volume' instance 66633a35-54c4-43cf-9173-307af9be25ed while it is in vm_state rescued May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Request method failure captured: May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: POST /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed/os-volume_attachments HTTP/1.1 May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 74 May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERVtl-lSxtKnD-S3B2Xt4kgPJOU6kBuQN11Sb1FuqqwO7bW9rMo8vZlXCoft9Hft3VMLZjEDTzH86PwKcKGCJPa6ytczeEYBZPm36-d-4WdkLJghrsraT70FMuHLMbwzqklas-xxSkAGQKJLTz793uz5PUbIov7aDD6Sv2raCqF2GI May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:26:15.117732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}] May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: e8fddb1cf74d4135b41000f8a6293020 May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {"volumeAttachment": {"volumeId": "32d02e21-5a90-4a75-a14b-91345335618a"}} May 27 03:26:15.119394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Cannot 'attach_volume' instance 66633a35-54c4-43cf-9173-307af9be25ed while it is in vm_state rescued May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'server_id': '66633a35-54c4-43cf-9173-307af9be25ed', 'body': {'volumeAttachment': {'volumeId': '32d02e21-5a90-4a75-a14b-91345335618a'}}} May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66633a35-54c4-43cf-9173-307af9be25ed in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:26:15.120830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 66633a35-54c4-43cf-9173-307af9be25ed while it is in vm_state rescued May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:26:15.122261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:26:15.123931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:26:15.123931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:26:15.123931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 66633a35-54c4-43cf-9173-307af9be25ed while it is in vm_state rescued May 27 03:26:15.123931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:15.127642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Returning 409 to user: Cannot 'attach_volume' instance 66633a35-54c4-43cf-9173-307af9be25ed while it is in vm_state rescued {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:26:15.128794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7d94845d-1a2e-4da2-9bd5-af9d2f401d48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.096663 May 27 03:26:15.129653 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 143/294] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:26:15 2022] POST /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 03:26:15.138609 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9ceebcfb-2987-41b3-a7b4-edda9b806e2d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:15.141453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9ceebcfb-2987-41b3-a7b4-edda9b806e2d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:15.158429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ceebcfb-2987-41b3-a7b4-edda9b806e2d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.159015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ceebcfb-2987-41b3-a7b4-edda9b806e2d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.159916 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ceebcfb-2987-41b3-a7b4-edda9b806e2d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.161147 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ceebcfb-2987-41b3-a7b4-edda9b806e2d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.317642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9ceebcfb-2987-41b3-a7b4-edda9b806e2d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed/action" status: 202 len: 0 microversion: 2.1 time: 0.182587 May 27 03:26:15.318776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 144/295] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:26:15 2022] POST /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:26:15.329776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:15.330749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:15.349517 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.350235 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.352571 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.353013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.661954 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a8802462-b62a-48cd-9744-82892374c2d5 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "POST /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617986 May 27 03:26:15.662810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 152/296] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:26:15 2022] POST /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448/os-volume_attachments => generated 194 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:15.705830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:15.719651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:15.741820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.742335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.743122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.743550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:16.047921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.069018 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.071553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.075179 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-aea11662-0471-4d6c-a6a1-4538b3bd4863 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1744 microversion: 2.20 time: 0.409572 May 27 03:26:16.076940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 153/297] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:15 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1744 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:16.097313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:16.098522 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.100998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:16.107428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:16.107933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:16.108708 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:16.109133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:16.113975 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-27c5ba5b-f721-4359-9eeb-6b5750865468 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1509 microversion: 2.1 time: 0.789206 May 27 03:26:16.114749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 145/298] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:15 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1509 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:16.452863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.467533 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-85a126c6-6183-4d30-b4aa-d19b65ef5885 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.374137 May 27 03:26:16.468791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 154/299] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:16 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:17.097337 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:17.108099 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:17.116363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.116530 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.141218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:17.147651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:17.156687 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.159336 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.191667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.197071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.200094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.203624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.526705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:17.556534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:17.558382 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:17.559576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1fe4f6e3-76ed-4398-a3b9-d0dae268e5b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.468727 May 27 03:26:17.584958 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 146/300] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:17 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:17.595199 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:17.595891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:17.603637 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.604763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.620921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.622127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.784088 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:17.804251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d77e2ce3-c482-4cc2-835a-4b78e6290748 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1509 microversion: 2.1 time: 0.676857 May 27 03:26:17.815984 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 155/301] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:17 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1509 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:18.239069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:18.255915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fbc2e1ff-5049-4110-a982-d9b1a5feca3f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.669734 May 27 03:26:18.278397 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 147/302] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:17 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:18.578100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:18.584820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:18.595632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:18.598029 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:18.599033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:18.599669 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:18.822156 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:18.823005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:18.829905 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:18.831335 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:18.832826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:18.837642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:18.857291 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:18.871286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:18.874313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:18.880466 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a739fa75-f096-4953-8015-60eaa0eae1b5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.304061 May 27 03:26:18.891216 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 156/303] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:18 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:18.897648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:19.138957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:19.148501 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4893a18a-bbd7-426c-8742-363d947f52f0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1509 microversion: 2.1 time: 0.330308 May 27 03:26:19.152416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 148/304] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:18 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:19.274237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:19.274843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:19.282901 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.283345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.284139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.284567 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.613731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:19.629440 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b5cd4ace-f89a-4b58-a022-bf64e13d33d9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.358239 May 27 03:26:19.640281 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 157/305] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:19 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:19.899436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:19.900682 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:19.929464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.940676 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.942370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.942964 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:20.115702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5cf7e964-2b31-4061-8b20-4d278549f42b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Action: 'create', calling method: .version_select at 0x7f40c0613040>, body: {"keypair": {"name": "tempest-TestShelveInstance-446497868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNKNOpltMaypAroCCN3jcvSe/5e4sI7GHqk8ifNlAMihJrhtU2HemQufzq8z5/E3YD87TfR4g0NOjQ9GcBYmyLom2mgT/JU2FD6t0R6K1xFMzDT/KApMhDfWMGx5aVNqw=="}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:20.135181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-5cf7e964-2b31-4061-8b20-4d278549f42b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Getting quotas for project 1d73ce3d68ac4f6e99f9a3b194cde320. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:26:20.139079 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:20.141683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-5cf7e964-2b31-4061-8b20-4d278549f42b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Getting quotas for user fcabfe4f1a6b41049ca2bd37d31759aa and project 1d73ce3d68ac4f6e99f9a3b194cde320. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:26:20.149382 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:20.151335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:20.152957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-af766171-21b0-4e17-83dc-0803d6a090c1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.258373 May 27 03:26:20.153765 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 158/306] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:19 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:20.170398 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:20.171287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:20.178274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:20.179048 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:20.180095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:20.181876 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:20.186934 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5cf7e964-2b31-4061-8b20-4d278549f42b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.442960 May 27 03:26:20.188229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 149/307] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:26:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:20.455238 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:20.463850 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9c152051-0a41-40ea-bfe0-1fd6f8892393 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1515 microversion: 2.1 time: 0.297301 May 27 03:26:20.467122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 159/308] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:20 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1515 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:20.655611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:20.656306 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:20.676521 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:20.679908 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:20.685599 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:20.690666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:20.961304 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:20.974016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-359a4775-474d-4de6-8ac8-15db19bfa0cb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.323947 May 27 03:26:20.974862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 150/309] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:20 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:21.172795 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:21.174099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:21.188618 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:21.192652 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:21.193656 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:21.195980 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:21.474281 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:21.484684 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:21.486967 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:21.488899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b8ad925c-cccd-490b-a69c-bc91fb92a0e7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.320017 May 27 03:26:21.490540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 160/310] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:21 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:21.998220 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:21.999567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:22.002946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:22.018751 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:22.019572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:22.023227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:22.025083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:22.293970 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a6e5d8d0-aa96-446c-867b-fa3e51d686f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'create', calling method: .version_select at 0x7f40c0de5dc0>, body: {"keypair": {"name": "tempest-keypair-1741973910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElmFf7eoXki0/RfARBXJ/r5rcFcUIOvlDWusRaYY90SFpsGw5eIW4Fr9ZJI/0U5U8s1ArlQzAO3r6nSFm6rd6JcPAilYdDVsnfASDfN4Wea179oD7lCYSpyvaJNuNDWTw=="}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:22.316872 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:22.331160 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8f38e0af-9837-4908-a653-b285b16c5aba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.337688 May 27 03:26:22.342247 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 151/311] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:21 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:22.342449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-a6e5d8d0-aa96-446c-867b-fa3e51d686f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:26:22.355605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-a6e5d8d0-aa96-446c-867b-fa3e51d686f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for user e8fddb1cf74d4135b41000f8a6293020 and project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:26:22.414454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a6e5d8d0-aa96-446c-867b-fa3e51d686f2 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126939 May 27 03:26:22.415387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 161/312] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:26:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:22.514978 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:22.515887 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:22.528175 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:22.528965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:22.530528 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:22.531111 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:22.770171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:22.778355 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:22.780187 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:22.781336 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-530ee93c-f14c-40c3-aa36-1dfa6f5a33fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.277245 May 27 03:26:22.781887 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 152/313] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:22 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:23.351517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:23.352166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:23.366677 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:23.370951 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:23.372159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:23.373005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:23.641740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:23.654026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e9b6c0f3-99b0-4db9-b769-4e0faacd3749 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.307770 May 27 03:26:23.654623 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 162/314] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:23 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:23.801347 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:23.802305 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:23.814808 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:23.815775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:23.817065 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:23.818676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:24.136133 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:24.149338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:24.150989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:24.156871 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e2116080-ff5a-460c-bb8b-204c7ee8cab8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.356364 May 27 03:26:24.157510 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 153/315] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:23 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:24.673574 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:24.675042 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:24.683217 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:24.683799 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:24.684972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:24.685639 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:24.702643 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:24.732878 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1385649927", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1891957d-4247-46a9-9554-49f7b2427352"}], "security_groups": [{"name": "tempest-securitygroup--1647191987"}], "key_name": "tempest-keypair-1741973910", "user_data": "}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:24.846534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:24.855082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c24a4424-70b3-4af6-9cda-adf5f4f54b38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.185465 May 27 03:26:24.855711 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 163/316] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:24 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:25.188015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:25.188015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:25.200272 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:25.203334 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:25.204762 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:25.205289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:25.353251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:25.362308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:25.365684 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:25.368657 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7a96e971-efb7-414c-8c0c-bccfd7110a20 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.187592 May 27 03:26:25.370804 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 164/317] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:25 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:25.872712 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:25.874145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:25.882631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:25.883205 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:25.884079 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:25.884721 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.033416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:26.043883 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d2f72121-beca-404f-a05c-be0a1ff4bf38 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.174716 May 27 03:26:26.044973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 165/318] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:25 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:26.390049 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:26.390732 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:26.397725 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.398259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.399099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.399598 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.575799 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:26.586556 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:26.588059 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:26.589196 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7e3c19fa-be2a-4305-a6d5-b8e225cfc818 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.203375 May 27 03:26:26.589743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 166/319] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:26 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:27.061616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:27.062337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:27.069133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:27.069773 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:27.070782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:27.071209 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:27.232420 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.242424 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-51760ad4-fa7d-41bb-9c11-23dea16909ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.184622 May 27 03:26:27.243319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 167/320] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:27 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:27.608921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:27.611335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:27.618556 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:27.619139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:27.621525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:27.621956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:27.783550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.795596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.797889 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.799601 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fbf09286-75eb-4dbb-8e93-ebc410ee64de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.195566 May 27 03:26:27.800892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 168/321] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:27 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:28.262004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:28.263350 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:28.271032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.271690 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:28.272852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.273448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:28.473669 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:28.482733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-929fbc40-21f4-4a69-9c36-8dab15faa5c2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.226568 May 27 03:26:28.483326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 169/322] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:28 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:28.819176 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:28.819959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:28.826917 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.827485 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:28.828386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.828929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:28.980306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:28.989890 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:28.996005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:28.997401 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-166c07aa-9ef5-4e85-99de-d79dde053299 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.182903 May 27 03:26:28.997946 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 170/323] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:28 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:29.501125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:29.501859 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:29.509395 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:29.510157 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:29.511002 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:29.511505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:29.691708 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:29.701415 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2fe0ee51-234c-4186-bd7a-d5e9f349080e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.203883 May 27 03:26:29.701992 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 171/324] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:29 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:30.016139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:30.016671 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:30.023515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.023996 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.024759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.025195 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.153257 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=4 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:30.169359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.177566 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.180484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.180484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-35202f8b-7d7f-4c1c-948a-519b192bd303 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.168231 May 27 03:26:30.184672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 172/325] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:30 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:30.307459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] validate_networks() for [('1891957d-4247-46a9-9554-49f7b2427352', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:26:30.714947 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:26:30.715470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:26:30.716061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:26:30.716946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:26:30.717061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:26:30.720880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:30.721596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:30.726789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.727322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.728479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.728699 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.739040 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.739621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.740498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.740943 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.748004 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:26:30.752112 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Getting quotas for user e8fddb1cf74d4135b41000f8a6293020 and project 5e539cb7b0fe47d6bdece2805d4ad0c1. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:26:30.763947 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:26:30.766295 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:26:30.817186 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a595d00f-208d-4d8e-b248-d5a90f8fbf6a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.088789 May 27 03:26:30.818186 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 154/326] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:26:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 6091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:26:30.828218 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a883b521-d390-4d04-bc7e-692ce277a590 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:30.828951 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a883b521-d390-4d04-bc7e-692ce277a590 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:30.883853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.891319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a883b521-d390-4d04-bc7e-692ce277a590 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.892909 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7cb4eaca-4299-4df6-958e-ce1e4e2498fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.176704 May 27 03:26:30.893703 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 173/327] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:30 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:30.898574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a883b521-d390-4d04-bc7e-692ce277a590 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1246 microversion: 2.1 time: 0.074637 May 27 03:26:30.899261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 155/328] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:30 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:31.198306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:31.198914 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:31.205192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.205640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.206430 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.206861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.332342 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:31.340165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:31.341715 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:31.342873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-80094646-3d92-4987-8106-fb2b3a2ed92d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1739 microversion: 2.20 time: 0.148565 May 27 03:26:31.343417 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 174/329] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:31 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:31.909898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:31.910564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:31.914471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:31.915152 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:31.921159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.921159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.921159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.921159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.925823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.926280 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.927056 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.927492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:32.000324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.011539 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-61d81022-65d8-4f0c-b6a7-b04757e480fd tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1242 microversion: 2.1 time: 0.100563 May 27 03:26:32.012763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 175/330] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:31 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:32.092766 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.101276 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-03597de6-0aee-422b-a642-b5ac6a2e0b1b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.195157 May 27 03:26:32.101852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 156/331] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:31 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:32.361385 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:32.361940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:32.367599 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=4 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:32.369188 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:32.369632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:32.370381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:32.370810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:32.503812 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.511964 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.513461 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.514649 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-43bf1a75-3df6-4221-a7eb-de92f4162c92 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1721 microversion: 2.20 time: 0.157199 May 27 03:26:32.515197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 176/332] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:32 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:33.035833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:33.036457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:33.042865 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.043329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.044100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.044528 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.120398 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:33.121259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:33.127506 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:33.129319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.129992 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.130912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.132375 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.136095 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0db5533c-4656-4c89-9b02-27fd308269fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1316 microversion: 2.1 time: 0.104017 May 27 03:26:33.137033 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 157/333] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:33 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:33.278342 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:33.290070 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-29c66c30-8de7-4ecc-a0fc-44b62115bb7a tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.174761 May 27 03:26:33.290895 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 177/334] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:33 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:33.532453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:33.532986 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:33.539019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.539457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.540231 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.540660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.668577 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:33.677216 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:33.678787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:33.680055 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ea33b514-5e22-4344-97da-94f9b7b496b8 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1721 microversion: 2.20 time: 0.151479 May 27 03:26:33.680637 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 158/335] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:33 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:34.154229 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:34.154850 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:34.161836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.162276 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.163019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.163449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.227658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.235303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-21ecd38c-6e92-45c6-981b-2aea6fddb488 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1304 microversion: 2.1 time: 0.085026 May 27 03:26:34.235877 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 178/336] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:34 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:34.308867 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:34.309467 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:34.316019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.316466 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.317233 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.317647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.444169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.452278 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ae55aea2-7613-4fc0-8082-3c874702180f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.147366 May 27 03:26:34.452839 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 159/337] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:34 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:34.698639 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:34.699181 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:34.705462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.706403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.707155 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.707584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.836570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.844703 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.846198 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.847942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-671c3223-4830-4cc9-85a2-34abb6726f13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1721 microversion: 2.20 time: 0.153370 May 27 03:26:34.848494 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 179/338] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:34 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:35.253529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:35.254125 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:35.260164 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.260614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.261360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.261791 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.321158 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:35.328848 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-16d835ac-2043-4ca6-a430-6e07aef06dd3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1304 microversion: 2.1 time: 0.079791 May 27 03:26:35.329408 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 160/339] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:35 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1304 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:35.468939 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:35.469544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:35.476167 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.476616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.477399 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.477831 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.481691 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:35.604262 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:35.612762 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-97d2efe0-7c16-43af-acce-e55f9aa25a50 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.147046 May 27 03:26:35.613319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 180/340] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:35 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:35.866400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:35.867239 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:35.873447 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.873941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.874697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.875124 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.003204 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.011152 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.012678 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.013811 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c7821249-2f55-4920-b7ff-52da63e1f349 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1721 microversion: 2.20 time: 0.152205 May 27 03:26:36.014352 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 161/341] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:35 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:36.345032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:36.345844 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:36.352377 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.352823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.353586 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.354018 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.417968 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.426085 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5b87f2d6-5a1b-44f9-ace7-39bf66433646 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1304 microversion: 2.1 time: 0.084793 May 27 03:26:36.426668 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 181/342] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:36 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:36.630736 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:36.631424 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:36.638130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.638876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.639699 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.640226 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.941501 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.952557 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-cde14837-4947-4c81-a30a-f19c118c5e2b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.326220 May 27 03:26:36.963840 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 162/343] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:36 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:37.031497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:37.032147 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:37.040100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.040551 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.041325 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.041756 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.182055 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.190256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.191764 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.192961 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ae136597-9801-4310-8b77-a476ccf7693c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1721 microversion: 2.20 time: 0.165301 May 27 03:26:37.193511 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 182/344] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:37 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:37.443707 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:37.444326 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:37.450523 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.451302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.452461 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.452894 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.523976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-98658887-229e-4685-8935-b2531a9bb715 req-42905803-00e9-411b-a293-451c8ad5e83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668956ce-1a9e-43d1-a8d9-6ed759ad30f3", "name": "network-vif-unplugged", "status": "completed", "tag": "906f93e1-97e9-4418-8ad2-066ad5cfe98a"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:37.532715 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-98658887-229e-4685-8935-b2531a9bb715 req-42905803-00e9-411b-a293-451c8ad5e83f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.533421 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-98658887-229e-4685-8935-b2531a9bb715 req-42905803-00e9-411b-a293-451c8ad5e83f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.546226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-98658887-229e-4685-8935-b2531a9bb715 req-42905803-00e9-411b-a293-451c8ad5e83f service nova] Creating event network-vif-unplugged:906f93e1-97e9-4418-8ad2-066ad5cfe98a for instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 on hv-cinder-82880 May 27 03:26:37.551259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-98658887-229e-4685-8935-b2531a9bb715 req-42905803-00e9-411b-a293-451c8ad5e83f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031420 May 27 03:26:37.551928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 183/345] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:37.595232 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.603330 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-26db0122-17ae-407c-8b06-497b72dbe180 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.164249 May 27 03:26:37.603916 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 163/346] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:37 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:37.970634 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:37.971345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:37.977568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.978005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.978752 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.979182 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.115736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.124145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8688868b-ff6f-4a05-91d1-074fed1f6e34 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.157656 May 27 03:26:38.124699 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 184/347] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:37 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:38.211228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:38.211789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:38.218568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.219013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.219786 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.220245 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.347763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.355965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.357460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.358628 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-900d6ce1-3b8f-4621-8dcf-79aa31cc5e57 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1721 microversion: 2.20 time: 0.151412 May 27 03:26:38.359180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 164/348] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:38 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:38.620175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:38.620771 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:38.626828 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.627278 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.628048 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.628477 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.757298 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.766168 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b2a172a5-d540-42a2-94a5-7b1f2bbad2f3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.149681 May 27 03:26:38.767033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 185/349] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:38 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:39.142642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:39.143992 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:39.151179 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.151693 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:39.152560 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.153061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:39.291291 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:39.299307 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b5b541ab-ac90-4315-9470-089556ac2d63 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1723 microversion: 2.1 time: 0.161179 May 27 03:26:39.299891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 165/350] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:39 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:39.379068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:39.379779 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:39.386835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.387277 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:39.388069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.388495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:39.518591 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:39.528330 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:39.529848 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:39.531212 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-15014f2c-f7f4-43d3-926b-05f89e771e40 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1721 microversion: 2.20 time: 0.157199 May 27 03:26:39.531761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 186/351] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:39 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:39.783216 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:39.783470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:39.790323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.790890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:39.792044 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.792738 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.041706 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.050146 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d47899eb-fd69-4dfa-963c-f74337ec9f5f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.271105 May 27 03:26:40.050729 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 166/352] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:39 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:40.266956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:40.267947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:40.275752 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.276684 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.278300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.284528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.318059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:40.318764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:40.327976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.328873 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.330052 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.330861 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.450874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lazy-loading 'services' on Instance uuid 2466e9b1-1269-4e12-b60a-3ada2d5b5448 {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:26:40.570802 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.577007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:40.582091 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8195042d-8cba-4235-b3fb-7abb40e98cc7 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1700 microversion: 2.1 time: 0.267947 May 27 03:26:40.582745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 167/353] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:40 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1700 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:40.589599 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-83defb91-b72a-4f0e-b36d-c7ccf3249db4 req-65fb6d93-144a-4b00-9389-a218b6c8436a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe5601a-821f-42fb-8ad4-090c4640928d", "tag": "f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:40.605178 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4fe19cee-8261-457d-89b0-a696c535cf11 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448/os-volume_attachments/99ccddd1-3a42-4201-b571-15c2574143e0" status: 202 len: 0 microversion: 2.1 time: 0.342271 May 27 03:26:40.608233 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 187/354] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:26:40 2022] DELETE /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448/os-volume_attachments/99ccddd1-3a42-4201-b571-15c2574143e0 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:26:40.619031 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-83defb91-b72a-4f0e-b36d-c7ccf3249db4 req-65fb6d93-144a-4b00-9389-a218b6c8436a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.619729 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-83defb91-b72a-4f0e-b36d-c7ccf3249db4 req-65fb6d93-144a-4b00-9389-a218b6c8436a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.626023 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:40.627454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:40.636228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-83defb91-b72a-4f0e-b36d-c7ccf3249db4 req-65fb6d93-144a-4b00-9389-a218b6c8436a service nova] Creating event network-changed:f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2 for instance bbe5601a-821f-42fb-8ad4-090c4640928d on hv-cinder-82880 May 27 03:26:40.638754 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.639214 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.640623 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.641072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.645621 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-83defb91-b72a-4f0e-b36d-c7ccf3249db4 req-65fb6d93-144a-4b00-9389-a218b6c8436a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059588 May 27 03:26:40.650972 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 168/355] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:40.657823 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8f62c6cd-345f-4ad6-94f1-5f9699e384d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:40.666973 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8f62c6cd-345f-4ad6-94f1-5f9699e384d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.668432 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8f62c6cd-345f-4ad6-94f1-5f9699e384d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.711764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8f62c6cd-345f-4ad6-94f1-5f9699e384d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Going to try to start instance {{(pid=117609) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 03:26:40.741941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:40.796520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8f62c6cd-345f-4ad6-94f1-5f9699e384d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action" status: 202 len: 0 microversion: 2.1 time: 0.143244 May 27 03:26:40.797453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 169/356] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:26:40 2022] POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:26:40.813138 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:40.814213 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:40.818518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.822363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.822893 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.824184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.824842 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.829107 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.831459 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.832947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-103b46f6-c05e-4795-ac07-424ff102bdb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1664 microversion: 2.20 time: 0.223207 May 27 03:26:40.833604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 188/357] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:40 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1664 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:40.851449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ff58a2f0-fd62-4b0f-8cfe-a47d282756b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929668c0-545c-448f-ac98-4d66db656172"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:40.852775 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ff58a2f0-fd62-4b0f-8cfe-a47d282756b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:40.858922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff58a2f0-fd62-4b0f-8cfe-a47d282756b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.859440 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff58a2f0-fd62-4b0f-8cfe-a47d282756b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.862492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff58a2f0-fd62-4b0f-8cfe-a47d282756b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.862944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff58a2f0-fd62-4b0f-8cfe-a47d282756b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.896061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=8 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:40.973524 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.982174 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-71f3dd27-3391-4f10-bafc-5f9616df90d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.174405 May 27 03:26:40.982782 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 170/358] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:40 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:41.067720 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:41.068285 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:41.075010 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.075760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.076801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.077231 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.173117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ff58a2f0-fd62-4b0f-8cfe-a47d282756b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325562 May 27 03:26:41.178941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 189/359] 10.222.0.62 () {62 vars in 1363 bytes} [Fri May 27 03:26:40 2022] POST /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:26:41.232873 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.241745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8a360f13-cf9a-406c-b87e-e1b9e78adadc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.178438 May 27 03:26:41.244047 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 171/360] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:41 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:41.306495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8f0b51c2-c103-4069-80e2-3e49a65d1968 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:41.307130 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8f0b51c2-c103-4069-80e2-3e49a65d1968 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:41.313586 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0b51c2-c103-4069-80e2-3e49a65d1968 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.314085 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0b51c2-c103-4069-80e2-3e49a65d1968 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.315490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0b51c2-c103-4069-80e2-3e49a65d1968 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.315962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f0b51c2-c103-4069-80e2-3e49a65d1968 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.418024 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8f0b51c2-c103-4069-80e2-3e49a65d1968 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/action" status: 202 len: 0 microversion: 2.20 time: 0.116751 May 27 03:26:41.421675 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 190/361] 10.222.0.62 () {62 vars in 1318 bytes} [Fri May 27 03:26:41 2022] POST /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:26:41.428316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:41.429420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:41.436201 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.436640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.437391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.437969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.746043 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.761801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.768064 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.770132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bd5c20c2-0078-4809-86e8-392ac19071be tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1750 microversion: 2.20 time: 0.346435 May 27 03:26:41.770708 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 172/362] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:41 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1750 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:41.999184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:41.999790 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:42.005864 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.006311 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.007067 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.007493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.170023 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.178086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cd516fd0-e1c8-4c05-a0e1-c8333ad64fe9 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.182744 May 27 03:26:42.182070 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 191/363] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:41 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:42.260719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:42.261472 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:42.267492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.268551 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.269310 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.269741 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.421294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.429974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-af168f1e-6c00-49fc-a91a-0e7861a38b4d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.173161 May 27 03:26:42.431196 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 173/364] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:42 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:42.788228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:42.788819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:42.795318 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.795759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.796541 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.796964 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.850441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:42.850943 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:42.857983 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.858417 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.859165 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.859592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.885538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:26:42.928558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.944423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.946166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.947501 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3ff3afdf-70dd-46c0-ba6a-0f989c80d140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1750 microversion: 2.20 time: 0.163145 May 27 03:26:42.948242 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 192/365] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:42 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:42.982953 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b9122e26-15fd-4548-bfb1-8b98da178391 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 204 len: 0 microversion: 2.1 time: 0.136007 May 27 03:26:42.983538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 174/366] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:26:42 2022] DELETE /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:26:42.993120 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:42.993885 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:43.001648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.003087 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.004192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.004807 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.010520 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:43.152918 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:43.160878 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-aeec3c3e-deca-49a8-be6f-fb53bdd19faf tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.172526 May 27 03:26:43.161425 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 193/367] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:42 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:43.196569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:43.197187 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:43.203734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.204494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.205413 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.206000 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.340856 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:43.349324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5cc25b95-2c89-40cb-bfb9-220ef53c2e26 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.157067 May 27 03:26:43.349892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 175/368] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:43 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:43.448198 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:43.448721 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:43.455111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.455553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.456354 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.456791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.587737 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:43.598733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6aa7a9e6-2926-4e91-8c04-334ddeb9af8d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.154404 May 27 03:26:43.607723 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 194/369] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:43 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:43.966016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:43.966574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:43.973489 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.973927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.974685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.975108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.114595 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.122831 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.124327 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.125451 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6cd4d689-c1c6-4e41-8199-576cc1e2118b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.163492 May 27 03:26:44.126014 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 176/370] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:43 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:44.178219 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:44.178819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:44.181139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:44.187700 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.188161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.188917 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.189339 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.330836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.336970 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-91b21c80-fa29-4533-a99f-2609126897b7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.163113 May 27 03:26:44.337528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 195/371] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:44 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:44.366203 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:44.366820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:44.372783 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.373380 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.374168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.374892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.505281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.513205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-55cfb6e9-1fa4-426d-90c0-cd3c79365f99 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.150702 May 27 03:26:44.513767 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 177/372] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:44 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:44.614366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:44.615089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:44.621499 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.621941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.622698 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.623128 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.755543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.763104 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5f81145b-2185-4b36-aed7-724d876a93b6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.152480 May 27 03:26:44.763742 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 196/373] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:44 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:45.144145 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:45.144754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:45.151162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.151609 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.152533 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.152883 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.287068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:45.295945 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:45.297474 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:45.299108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-512fd698-142b-4f7e-ba5d-b09550ff584a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.158686 May 27 03:26:45.299667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 178/374] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:45 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:45.354566 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:45.355052 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:45.363015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.363674 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.364642 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.365071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.491590 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:45.499125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b5ab8b8f-3c38-4f97-8adf-ef054961deb2 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.148566 May 27 03:26:45.499689 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 197/375] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:45 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:45.530698 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:45.531228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:45.538917 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.539365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.540177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.540614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.664855 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-ce32f060-a478-476d-9a6d-21a7a8938b85 req-919c341d-624f-4bef-a1d4-2407f8d2989c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe5601a-821f-42fb-8ad4-090c4640928d", "name": "network-vif-plugged", "status": "completed", "tag": "f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:45.674418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ce32f060-a478-476d-9a6d-21a7a8938b85 req-919c341d-624f-4bef-a1d4-2407f8d2989c service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.674966 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ce32f060-a478-476d-9a6d-21a7a8938b85 req-919c341d-624f-4bef-a1d4-2407f8d2989c service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.675768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:45.686594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-69433125-def1-4dae-b3ed-94882105d805 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.159937 May 27 03:26:45.687492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 179/376] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:45 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:45.689132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-ce32f060-a478-476d-9a6d-21a7a8938b85 req-919c341d-624f-4bef-a1d4-2407f8d2989c service nova] Creating event network-vif-plugged:f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2 for instance bbe5601a-821f-42fb-8ad4-090c4640928d on hv-cinder-82880 May 27 03:26:45.694357 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-ce32f060-a478-476d-9a6d-21a7a8938b85 req-919c341d-624f-4bef-a1d4-2407f8d2989c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 May 27 03:26:45.695042 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 198/377] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:45.780790 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:45.781304 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:45.787876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.788990 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.789847 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.790279 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.923064 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:45.930518 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4e102d55-68f5-4ac8-8933-05d66859fab6 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.153577 May 27 03:26:45.931082 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 180/378] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:45 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:46.318257 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:46.318869 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:46.325151 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.325860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.326615 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.327050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.461830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.470822 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.472382 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.473568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0a019ec3-8e7d-4fe1-892e-59e3e8a6ed3d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.160169 May 27 03:26:46.474134 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 199/379] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:46 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:46.515646 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:46.516373 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:46.523229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.523680 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.524478 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.524913 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.656261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.663946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4d9ad34a-a7f8-4104-badb-c2a1c06acb90 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.151932 May 27 03:26:46.664535 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 181/380] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:46 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:46.704771 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:46.705367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:46.711383 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.711842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.712592 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.713018 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.840713 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.849180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-87d62d3d-32e3-4734-9907-f8a42bb06303 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.148242 May 27 03:26:46.849743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 200/381] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:46 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:46.946457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:46.947089 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:46.953387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.953832 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.954580 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.955010 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.973032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:47.085400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.092831 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5b1423f6-c443-4250-b0be-ae4d35c050a5 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.150273 May 27 03:26:47.093395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 182/382] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:46 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:47.490561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:47.491193 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:47.497766 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.498210 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.498958 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.499388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.629592 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.638660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.640202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.641373 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a6087475-bfac-4633-8a4b-53644618a140 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.154721 May 27 03:26:47.641935 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 201/383] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:47 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:47.681293 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:47.681892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:47.688492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.688939 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.689700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.690151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.842291 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.849934 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ba6568ac-9ccd-4ba0-b7f9-167af6c7eb84 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.172492 May 27 03:26:47.850500 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 183/384] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:47 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:47.866497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:47.867107 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:47.873225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.873652 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.874413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.874843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.004185 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.012084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-83e595b8-4835-4257-99ae-6fdd18d030a6 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.149431 May 27 03:26:48.012636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 202/385] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:47 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:48.109943 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:48.110547 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:48.117131 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.117583 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.118386 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.118762 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.254037 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.261897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-df48adb1-4e44-408f-a5e4-51f0b54a8be8 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.155729 May 27 03:26:48.262456 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 184/386] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:48 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:48.659141 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:48.660260 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:48.666677 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.667117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.667884 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.668312 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.808761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.817292 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.818779 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.819940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-18afdfb3-8f4a-489d-8c14-ac62aa0fb3a1 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.164565 May 27 03:26:48.820495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 203/387] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:48 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:48.866438 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:48.867069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:48.873520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.873962 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.874712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.875140 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.003061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.010634 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fe0d30ad-9c76-48d8-a800-c282c81fc511 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.148030 May 27 03:26:49.011137 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 185/388] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:48 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:49.028535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:49.029139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:49.035726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.036214 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.036970 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.037400 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.278728 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:49.279433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:49.285666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.286101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.286859 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.287283 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.365600 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.374127 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9718aaa4-c0f7-49bc-9788-3b6d932928cf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.349301 May 27 03:26:49.374714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 204/389] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:49 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:49.617128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.617850 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-cd73840e-d493-47e6-b807-6ad1dad76ec1 req-e3595fc5-9c06-4510-b04f-3d3dba37cd38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2466e9b1-1269-4e12-b60a-3ada2d5b5448", "name": "network-vif-unplugged", "status": "completed", "tag": "3241390e-ae71-4f08-8375-de655134e942"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:49.625712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ead109dc-426c-4d1f-a382-df32ea51ae44 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.350915 May 27 03:26:49.626661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cd73840e-d493-47e6-b807-6ad1dad76ec1 req-e3595fc5-9c06-4510-b04f-3d3dba37cd38 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.626949 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 186/390] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:49 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:49.627102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cd73840e-d493-47e6-b807-6ad1dad76ec1 req-e3595fc5-9c06-4510-b04f-3d3dba37cd38 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.641159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-cd73840e-d493-47e6-b807-6ad1dad76ec1 req-e3595fc5-9c06-4510-b04f-3d3dba37cd38 service nova] Creating event network-vif-unplugged:3241390e-ae71-4f08-8375-de655134e942 for instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 on hv-cinder-82880 May 27 03:26:49.646394 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-cd73840e-d493-47e6-b807-6ad1dad76ec1 req-e3595fc5-9c06-4510-b04f-3d3dba37cd38 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032345 May 27 03:26:49.646976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 205/391] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:26:49.838351 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:49.838979 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:49.845028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.845475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.846229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.846664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.973580 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.981940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.983418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.984573 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-18c6bec9-52b1-4b32-9a34-27a13a5a0f80 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.150171 May 27 03:26:49.985125 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 187/392] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:49 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:50.028738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:50.029434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:50.035539 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.036022 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.036776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.037207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.163891 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:50.171204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-29195974-7c0d-4f25-96d3-f8e1fa41174e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.147193 May 27 03:26:50.171761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 206/393] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:50 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:50.392490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:50.393094 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:50.399164 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.399616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.400401 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.400833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.529395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:50.537268 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3e38cebd-2ff5-4ac9-a235-7ab029ea5bf2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.148649 May 27 03:26:50.537834 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 188/394] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:50 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:50.642955 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:50.643496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:50.649580 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.650024 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.650774 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.651202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.778160 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:50.786082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f7019d95-f424-45a0-b49b-8b2797afce89 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.146941 May 27 03:26:50.786650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 207/395] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:50 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:51.002332 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:51.002987 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:51.005440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:51.011471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.011931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.012684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.013113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.142897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:51.151612 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:51.153123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:51.154261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9599b53a-d294-47d2-8435-ffa1c5036374 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.155810 May 27 03:26:51.154809 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 189/396] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:50 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:51.187990 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:51.188570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:51.195109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.195560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.196351 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.196786 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.322173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:51.329896 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-dff2b39b-73d7-4d33-9b40-babd7182dbe8 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.145818 May 27 03:26:51.330458 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 208/397] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:51 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:51.554308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:51.554831 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:51.561175 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.561614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.562356 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.562780 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.701447 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:51.710058 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-01a869d8-8a84-4563-93d8-85be7b24a08f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.159609 May 27 03:26:51.710648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 190/398] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:51 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:51.803437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:51.804108 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:51.810765 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.811149 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.811916 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.812342 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.942224 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:51.963679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8adf0f04-732b-4157-a2f3-ad7c15226509 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.164785 May 27 03:26:51.964287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 209/399] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:51 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:52.172733 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:52.173339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:52.180425 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.180873 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.181625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.182056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.308760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.317652 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.319272 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.320479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5376590c-d47b-4e5f-811c-f5ee524f4129 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.151559 May 27 03:26:52.321036 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 191/400] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:52 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:52.346241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:52.347380 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:52.353906 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.354356 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.355117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.355553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.482130 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.489698 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-62fd40b8-43cd-4ee4-bdd8-56e44cd36c49 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.147265 May 27 03:26:52.490260 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 210/401] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:52 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:52.726833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:52.727461 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:52.733452 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.733891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.734636 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.735058 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.865299 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.873238 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-10c7011c-1f65-44e5-ac3d-463d868551ee tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.150181 May 27 03:26:52.873795 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 192/402] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:52 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:52.980651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:52.981405 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:52.987546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.988046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.988794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:52.989220 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.991882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:53.122181 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.130876 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a94ce395-9d42-45c0-9cab-54dd393fa95d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.154008 May 27 03:26:53.131443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 211/403] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:52 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:53.338848 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:53.339462 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:53.346919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.347746 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.348821 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.349259 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.507127 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:53.507725 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:53.515559 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.516291 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.517286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.517956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.654575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.659682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.662725 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-217afe37-93be-4a76-a825-dc26d7e99056 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1512 microversion: 2.1 time: 0.160141 May 27 03:26:53.669946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.670847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 212/404] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:53 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:53.671463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.672948 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0b16713a-e922-412e-8f53-627fd340b3a2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.338144 May 27 03:26:53.673502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 193/405] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:53 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:53.886006 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-ba2ea39f-6998-4d9c-8f76-e5656d03c46d req-1255fae5-bc8a-431e-8cd5-2a327a1f94d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2466e9b1-1269-4e12-b60a-3ada2d5b5448", "name": "network-vif-deleted", "tag": "3241390e-ae71-4f08-8375-de655134e942"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:53.890090 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:53.890699 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:53.894000 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ba2ea39f-6998-4d9c-8f76-e5656d03c46d req-1255fae5-bc8a-431e-8cd5-2a327a1f94d7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.894432 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ba2ea39f-6998-4d9c-8f76-e5656d03c46d req-1255fae5-bc8a-431e-8cd5-2a327a1f94d7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.896836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.897288 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.898112 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.898546 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.906305 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-ba2ea39f-6998-4d9c-8f76-e5656d03c46d req-1255fae5-bc8a-431e-8cd5-2a327a1f94d7 service nova] Creating event network-vif-deleted:3241390e-ae71-4f08-8375-de655134e942 for instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 on hv-cinder-82880 May 27 03:26:53.911840 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-ba2ea39f-6998-4d9c-8f76-e5656d03c46d req-1255fae5-bc8a-431e-8cd5-2a327a1f94d7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029523 May 27 03:26:53.912440 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 213/406] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:54.036338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.044861 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1785eaed-544b-418a-b26b-072e4d91d083 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1709 microversion: 2.1 time: 0.158509 May 27 03:26:54.045434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 194/407] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:53 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:54.147654 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:54.148456 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:54.154975 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.155659 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.156471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.157058 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.292274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.300550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-222eda6b-5bb4-409a-84ed-96027217ab57 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.157175 May 27 03:26:54.301100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 214/408] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:54 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:54.680066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:54.680901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:54.689480 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.689937 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.690709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.691144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.692421 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:54.693594 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:54.704490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.704490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.704490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.704490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.776533 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.785369 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2e4baa39-7152-4047-9226-15eb46ea2f9f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1303 microversion: 2.1 time: 0.108979 May 27 03:26:54.786237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 195/409] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:54 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:54.854101 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.862680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.864232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.865381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-38887374-8458-4b9f-8c33-ed953db0ee75 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.178262 May 27 03:26:54.865936 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 215/410] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:54 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:55.068594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:55.068594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:55.069490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.069931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.070703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.071389 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.198441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:55.206796 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-86046097-66b9-48e9-b116-fd8b757e694e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1713 microversion: 2.1 time: 0.148237 May 27 03:26:55.207363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 196/411] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:55 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1713 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:55.316728 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:55.317341 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:55.323386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.323802 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.324704 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.325397 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.457771 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:55.465200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8e6042a1-8766-4fd3-b38f-0c6c66418c2f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1372 microversion: 2.1 time: 0.152540 May 27 03:26:55.465762 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 216/412] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:55 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:55.801999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:55.802602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:55.809377 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.809818 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.810572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.811003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.851104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.851337 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.851792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lazy-loading 'fault' on Instance uuid 2466e9b1-1269-4e12-b60a-3ada2d5b5448 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:26:55.883860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:55.884625 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:55.891912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.892661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.894161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.895318 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.897301 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:55.905085 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ea50b9f4-b0f2-4047-a8bb-c165b334abd9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1308 microversion: 2.1 time: 0.106802 May 27 03:26:55.913822 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 197/413] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:55 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:56.028449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.037105 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.038612 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.039762 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-64d5238a-fc1e-409d-88f3-a9bc60e2cb93 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1752 microversion: 2.20 time: 0.159953 May 27 03:26:56.040357 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 217/414] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:55 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:56.482422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:56.483027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:56.489587 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.490037 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.490795 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.491235 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.662499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.666380 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:56.671500 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-12ae1b6a-68a8-404c-923b-439ddf9bdf95 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1565 microversion: 2.1 time: 0.192915 May 27 03:26:56.672107 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 198/415] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:56 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:56.688437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fa4f4e75-cc54-4979-8fea-0988c57d294a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:56.688924 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fa4f4e75-cc54-4979-8fea-0988c57d294a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:56.695066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fa4f4e75-cc54-4979-8fea-0988c57d294a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.695515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fa4f4e75-cc54-4979-8fea-0988c57d294a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.696329 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fa4f4e75-cc54-4979-8fea-0988c57d294a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.696765 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fa4f4e75-cc54-4979-8fea-0988c57d294a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.779291 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fa4f4e75-cc54-4979-8fea-0988c57d294a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094164 May 27 03:26:56.779443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 218/416] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:26:56 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:56.928737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:56.929391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:56.944632 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.945083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.959528 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.960354 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.045102 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:57.045719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.046818 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lazy-loading 'fault' on Instance uuid 2466e9b1-1269-4e12-b60a-3ada2d5b5448 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:26:57.058924 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:57.061474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:57.071367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:57.072219 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.073247 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:57.073910 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.136089 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.143547 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-98d8de3b-9f57-4385-8f11-c1a8cb43b0da tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 200 len: 1308 microversion: 2.1 time: 0.220451 May 27 03:26:57.144398 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 199/417] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:56 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:57.355444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.364937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.366580 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.368036 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-09fb944f-863b-4eda-892c-6c85587dde05 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.313753 May 27 03:26:57.368699 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 219/418] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:57 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:57.913448 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-d4f49287-f6a4-4858-add2-7bb1afd51525 req-8c16d446-b97b-41ea-af45-1ab327d8ce23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe5601a-821f-42fb-8ad4-090c4640928d", "tag": "f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:57.931323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-d4f49287-f6a4-4858-add2-7bb1afd51525 req-8c16d446-b97b-41ea-af45-1ab327d8ce23 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:57.938849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-d4f49287-f6a4-4858-add2-7bb1afd51525 req-8c16d446-b97b-41ea-af45-1ab327d8ce23 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.957771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-d4f49287-f6a4-4858-add2-7bb1afd51525 req-8c16d446-b97b-41ea-af45-1ab327d8ce23 service nova] Creating event network-changed:f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2 for instance bbe5601a-821f-42fb-8ad4-090c4640928d on hv-cinder-82880 May 27 03:26:57.964180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-d4f49287-f6a4-4858-add2-7bb1afd51525 req-8c16d446-b97b-41ea-af45-1ab327d8ce23 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054635 May 27 03:26:57.965596 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 200/419] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:58.051676 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1582543763", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-446497868", "security_groups": [{"name": "tempest-secgroup-smoke-219351649"}], "networks": [{"uuid": "05f54ac1-9832-48be-b4c5-af7fbf1a8fc1"}], "block_device_mapping_v2": [{"uuid": "04698f1d-aa06-4a31-8281-59a57fba43a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:58.161940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:58.162957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 2466e9b1-1269-4e12-b60a-3ada2d5b5448] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:58.176593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.177287 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.178297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.178948 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.214192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] HTTP exception thrown: Instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 could not be found. May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Request method failure captured: May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 HTTP/1.1 May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikESsWGpIepbtfpXAKWY-F9gLgmeb3J20yFbeUj6YmKD3kU_BPnjuWAoCWOUtiH4hgcUEqD_FX-FtszSNMVUJ94vARYhRNn3-Ei1-Dp-HqOUKgE23jGv37Ng_Hn2M2x_yVW-Rmd9eVw9dHerSDrec_zbD5WzGVkjpUyutTx8c_PEsGPg May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: aee9b49e32b848e2a75facdeef1aa8a5 May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesSnapshotTestJSON-77916036 May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:26:58.220266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aee9b49e32b848e2a75facdeef1aa8a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aee9b49e32b848e2a75facdeef1aa8a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aee9b49e32b848e2a75facdeef1aa8a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aee9b49e32b848e2a75facdeef1aa8a5"}]}] May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesSnapshotTestJSON-77916036 May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: aee9b49e32b848e2a75facdeef1aa8a5 May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-77916036 May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesSnapshotTestJSON-77916036-project May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 8b9bfcb74bc14e92b96e4169ed323399 May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesSnapshotTestJSON-77916036-project May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 could not be found. May 27 03:26:58.222471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '2466e9b1-1269-4e12-b60a-3ada2d5b5448'} May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 could not be found. May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:26:58.223341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 could not be found. May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 could not be found. May 27 03:26:58.225016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:26:58.226723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Returning 404 to user: Instance 2466e9b1-1269-4e12-b60a-3ada2d5b5448 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:26:58.226723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-077f97cd-656c-46fc-bc02-d8aa2fef339e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448" status: 404 len: 111 microversion: 2.1 time: 0.067966 May 27 03:26:58.240392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 201/420] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:58 2022] GET /compute/v2.1/servers/2466e9b1-1269-4e12-b60a-3ada2d5b5448 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:26:58.294618 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] validate_networks() for [('05f54ac1-9832-48be-b4c5-af7fbf1a8fc1', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:26:58.388999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:58.389638 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:58.402511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.402882 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.404538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.405138 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.705329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:58.716967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:58.719316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:58.720541 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b09c457a-acf8-41c0-b351-b8c27110d05e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.337327 May 27 03:26:58.728522 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 202/421] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:58 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:58.880920 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:26:58.881504 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:26:58.881985 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:26:58.882387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:26:58.882789 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:26:58.892518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.893605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.894686 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.895131 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.938590 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Getting quotas for project 1d73ce3d68ac4f6e99f9a3b194cde320. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:26:58.946016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Getting quotas for user fcabfe4f1a6b41049ca2bd37d31759aa and project 1d73ce3d68ac4f6e99f9a3b194cde320. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:26:59.038133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:26:59.040904 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04698f1d-aa06-4a31-8281-59a57fba43a9',volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:26:59.243325 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7e537b77-d340-4b6c-ae4f-cc602b9e1364 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.197400 May 27 03:26:59.250681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 220/422] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:26:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:26:59.255630 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8b1f87bd-7c14-4b66-b9fd-27f72a99c209 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:59.256913 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8b1f87bd-7c14-4b66-b9fd-27f72a99c209 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:59.326670 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8b1f87bd-7c14-4b66-b9fd-27f72a99c209 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.335781 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8b1f87bd-7c14-4b66-b9fd-27f72a99c209 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1088 microversion: 2.1 time: 0.083199 May 27 03:26:59.337308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 203/423] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:26:59 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:59.740089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:59.740810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:59.748922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.749373 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.750141 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.750574 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.883526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.892014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.894084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.895235 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ea208825-e2af-4464-b727-417318403e33 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.159505 May 27 03:26:59.895803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 221/424] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:26:59 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:27:00.353269 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:00.354052 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:00.361611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.362564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:00.363320 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.363745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:00.422335 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:00.430554 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-85a7f697-9f19-416b-8e46-384ccbf65032 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.080998 May 27 03:27:00.431118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 204/425] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:00 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:00.913658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:00.914261 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:00.920857 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.921297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:00.922050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.922483 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:01.052439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.062576 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.064166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.065865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-61a6a022-c9df-494b-8a19-b5e513e14c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.156675 May 27 03:27:01.066419 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 222/426] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:00 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:01.447440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:01.448002 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:01.454709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:01.455153 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:01.456543 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:01.456977 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:01.515151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.522583 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c9fff0a4-142f-4622-926d-c05c5f320187 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.079064 May 27 03:27:01.523142 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 205/427] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:01 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:02.084268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:02.084868 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:02.091328 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.091770 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:02.092564 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.092996 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:02.233937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:02.243225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:02.244816 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:02.246033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-705c6d21-70ef-487f-ba6d-18f20f04b03b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.165769 May 27 03:27:02.246811 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 223/428] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:02 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:02.539970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:02.540789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:02.547470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.547952 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:02.548711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.549177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:02.612190 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:02.619752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b6c34c88-6a74-431b-945c-6ed5f5d3e107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.083710 May 27 03:27:02.630806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 206/429] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:02 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:03.264924 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:03.265742 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:03.272144 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.272666 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.273439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.273878 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.433416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.443284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.444824 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.446010 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3842423d-6b03-4f9f-97e9-04edfaf5afb2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.184983 May 27 03:27:03.446642 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 224/430] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:03 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:03.637363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:03.637973 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:03.644655 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.645098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.645861 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.646304 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.713176 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.720773 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bbc361b5-bbff-4c6b-ac24-feb3627de84d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.087569 May 27 03:27:03.721984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 207/431] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:03 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:04.472575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:04.473371 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:04.480274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.480648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.481413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.481838 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.618238 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:04.628412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:04.630097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:04.631345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-62e4d587-a895-48a7-8870-704fed8877e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.162778 May 27 03:27:04.632125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 225/432] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:04 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:04.738972 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:04.739647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:04.747024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.747809 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.748819 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.749785 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.813865 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:04.822913 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-185f88cb-7159-4989-8149-629ba17ed9b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.088433 May 27 03:27:04.823743 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 208/433] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:04 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:05.649872 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:05.650474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:05.656969 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:05.657420 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.658180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:05.658642 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.793548 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.802515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.804511 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.805970 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e1427bbe-f5db-4ec3-8a10-e9eb368ab63f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.159958 May 27 03:27:05.807019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 226/434] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:05 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:05.840583 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:05.841508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:05.848266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:05.848783 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.849616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:05.850114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.914223 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.921951 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a37ad9f7-6823-4a96-bb55-a30ca116df19 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.085178 May 27 03:27:05.922525 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 209/435] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:05 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:06.825688 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:06.826264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:06.833300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.833743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.834552 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.834928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.938387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:06.940390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:06.948093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.948915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.950186 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.950833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.978950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.987763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.989452 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.990652 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cd90ab95-eef6-44d8-b97c-5b491e7ab5ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.169202 May 27 03:27:07.000321 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 227/436] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:06 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:07.015959 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:07.025972 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a4e39211-c462-45c6-843f-6b8e84998172 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.091273 May 27 03:27:07.026983 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 210/437] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:06 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:08.008716 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:08.009324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:08.015866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:08.016316 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:08.017072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:08.017504 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:08.044473 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:08.045780 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:08.053348 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:08.056829 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:08.057690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:08.058307 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:08.133695 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:08.143030 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a520815f-f540-43da-86fe-05f7b8b44fa3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.102610 May 27 03:27:08.149838 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 211/438] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:08 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:08.189901 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:08.199538 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:08.201503 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:08.202685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9c5e3cfc-f00e-4cfe-a27b-7c0809205b87 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.197896 May 27 03:27:08.203257 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 228/439] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:08 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:27:09.165976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:09.166582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:09.173109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.173548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.174833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.175260 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.221750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:09.222531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:09.224940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:09.225953 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=6 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:09.232732 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.233241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.234047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.234568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.243120 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:09.251110 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8a12fc3d-3a83-4e49-9308-28a0800af28d tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.088907 May 27 03:27:09.251685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 212/440] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:09 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:09.262229 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:09.386729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:09.395033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:09.396558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:09.397712 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-83cf4f0b-3947-41ca-a2eb-42ba771892ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.180122 May 27 03:27:09.398268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 229/441] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:09 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:27:10.268555 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:10.269100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:10.271005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:10.276713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.277158 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.277911 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.278342 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.345256 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:10.359051 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-939c6909-0632-4c60-948d-f97f82d6d418 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1138 microversion: 2.1 time: 0.094288 May 27 03:27:10.360525 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 213/442] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:10 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:10.417060 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:10.418316 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:10.433011 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.435151 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.436281 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.437208 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.455716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1633078388", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "networks": [{"uuid": "1d757b8e-3c2c-4d66-84a9-f19b199440d3"}]}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:10.519416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] validate_networks() for [('1d757b8e-3c2c-4d66-84a9-f19b199440d3', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:27:10.585852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:10.594660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:10.596890 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:10.598091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3f9e3d65-f1b3-4bba-af59-3f2dd3d2efb5 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.186548 May 27 03:27:10.598659 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 230/443] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:10 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:27:10.867410 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:27:10.867845 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:27:10.868339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:27:10.868746 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:27:10.869153 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:27:10.878390 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.878836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.879628 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.880093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.898932 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Getting quotas for project aee9b49e32b848e2a75facdeef1aa8a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:27:10.902810 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Getting quotas for user 8b9bfcb74bc14e92b96e4169ed323399 and project aee9b49e32b848e2a75facdeef1aa8a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:27:10.913497 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:27:10.915745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:27:10.961083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-57b0bede-6e49-4b92-ba98-30c502d6becc tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512526 May 27 03:27:10.961747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 214/444] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:27:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:27:10.971738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6ea3d339-4921-4f65-8ebe-9c21d12df3ec tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:10.972362 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6ea3d339-4921-4f65-8ebe-9c21d12df3ec tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:11.032489 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6ea3d339-4921-4f65-8ebe-9c21d12df3ec tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:11.040062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6ea3d339-4921-4f65-8ebe-9c21d12df3ec tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1219 microversion: 2.1 time: 0.072088 May 27 03:27:11.040935 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 231/445] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:10 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:11.376080 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:11.376684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:11.382922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:11.383368 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:11.384215 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:11.384593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:11.453341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:11.461498 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-821dd3bf-32aa-405f-af89-890321b0287c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1186 microversion: 2.1 time: 0.089623 May 27 03:27:11.462058 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 215/446] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:11 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:11.616307 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:11.617033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:11.623432 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:11.624034 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:11.624851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:11.625345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:11.758254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:11.766950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:11.769738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:11.771099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9c01befb-f6bc-4d9f-9d33-cceb3c1828cb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.158699 May 27 03:27:11.771646 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 232/447] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:11 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:12.057011 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:12.057644 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:12.063600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.064080 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:12.065395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.065825 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:12.129221 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:12.137183 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b7df7972-e87d-4993-ae66-ddac386ef2e7 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1271 microversion: 2.1 time: 0.083941 May 27 03:27:12.138095 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 216/448] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:12 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:12.479777 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:12.480388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:12.486493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.486933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:12.488028 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.488465 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:12.552335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:12.559986 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-19b6569a-7a47-49fe-9cb2-f6a7acd52e00 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1204 microversion: 2.1 time: 0.085042 May 27 03:27:12.560713 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 233/449] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:12 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:12.789322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:12.789929 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:12.796378 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.796820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:12.797567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.797991 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:13.093732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:13.104568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:13.106601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:13.108091 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fab642f6-929d-4a66-a46b-167875329b08 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.322354 May 27 03:27:13.110709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 217/450] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:12 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:13.157665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:13.158863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:13.167544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:13.167544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:13.167544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:13.168639 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:13.266139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:13.276209 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c7898f73-e4d4-4539-bede-be7b4447dcc3 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1277 microversion: 2.1 time: 0.122452 May 27 03:27:13.277860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 234/451] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:13 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:13.578023 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:13.578709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:13.585354 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:13.585802 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:13.586576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:13.587005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:13.596069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:13.871019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:13.878457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1de6e802-461d-482f-b7c5-85a84f2e25e6 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.304593 May 27 03:27:13.879125 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 218/452] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:13 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:14.126696 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:14.127423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:14.133448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.133885 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:14.134632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.135061 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:14.271881 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:14.281306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:14.282795 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:14.284590 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-1c87a29b-2cd7-4a28-9d1c-2e370d19570a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.161831 May 27 03:27:14.285145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 235/453] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:14 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:14.298026 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:14.298749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:14.304710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.305380 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:14.306137 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.306565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:14.587554 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:14.595100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-74e13064-7799-4461-9fcd-e2608b4cecba tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1319 microversion: 2.1 time: 0.301442 May 27 03:27:14.595671 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 219/454] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:14 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:14.894799 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:14.895408 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:14.897353 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:14.902559 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.903048 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:14.903800 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.904415 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.045757 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:15.055348 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-65ab6704-a703-4275-99d5-33b95fb6d48f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.164358 May 27 03:27:15.056073 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 236/455] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:14 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:15.122479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-f17647c9-ea31-4e4e-bb35-732f900403cf req-4662033c-b80c-4662-96cf-228142c3a409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46fbddd-5f15-41b9-aaab-7fe260aa7bcd", "tag": "71e11d00-d642-48e1-acfd-a532d0199408"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:15.131980 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f17647c9-ea31-4e4e-bb35-732f900403cf req-4662033c-b80c-4662-96cf-228142c3a409 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:15.140858 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f17647c9-ea31-4e4e-bb35-732f900403cf req-4662033c-b80c-4662-96cf-228142c3a409 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.154647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-f17647c9-ea31-4e4e-bb35-732f900403cf req-4662033c-b80c-4662-96cf-228142c3a409 service nova] Creating event network-changed:71e11d00-d642-48e1-acfd-a532d0199408 for instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd on hv-cinder-82880 May 27 03:27:15.165805 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-f17647c9-ea31-4e4e-bb35-732f900403cf req-4662033c-b80c-4662-96cf-228142c3a409 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046983 May 27 03:27:15.166782 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 220/456] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:15.302391 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:15.302987 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:15.309466 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:15.309902 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.310644 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:15.311066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.438528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:15.447492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:15.449296 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:15.450447 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b1b90e1a-44e1-428d-a77c-b83c054e1cf0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.151938 May 27 03:27:15.451005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 237/457] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:15 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:15.612194 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:15.612875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:15.618986 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:15.619427 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.620200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:15.620625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.923083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:15.931078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-afc8e3bc-f652-401e-b507-cce4897fb15e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1319 microversion: 2.1 time: 0.323075 May 27 03:27:15.931854 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 221/458] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:15 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:16.072872 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:16.073394 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:16.079671 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.080151 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:16.080900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.081325 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:16.206806 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:16.214366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a82a8a5a-1374-43a3-b0d6-34e353da540f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.145367 May 27 03:27:16.214928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 238/459] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:16 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:16.469033 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:16.469635 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:16.476760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.477204 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:16.477960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.478388 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:16.603409 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:16.611664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:16.613169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:16.614304 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5fbc3889-228e-41f1-b476-685bb9f820ef tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.149242 May 27 03:27:16.614859 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 222/460] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:16 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:27:16.948444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:16.949300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:16.956599 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.957041 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:16.957783 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.958211 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:17.085631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:17.092932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-44696d55-3319-4092-8d17-8b849a0331b4 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1319 microversion: 2.1 time: 0.148331 May 27 03:27:17.093492 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 239/461] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:16 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:17.183565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-97a690fc-4c09-4911-80d4-38962fa7b95a req-8cd693c6-17e5-4e7f-adcb-992164137bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3861273f-f82d-46bd-b0c7-ce36e0a9e7f9", "tag": "c9d2778e-8a9c-45f3-aca5-af5c4cfc112b"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:17.192511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-97a690fc-4c09-4911-80d4-38962fa7b95a req-8cd693c6-17e5-4e7f-adcb-992164137bbc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:17.192892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-97a690fc-4c09-4911-80d4-38962fa7b95a req-8cd693c6-17e5-4e7f-adcb-992164137bbc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:17.203723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-97a690fc-4c09-4911-80d4-38962fa7b95a req-8cd693c6-17e5-4e7f-adcb-992164137bbc service nova] Creating event network-changed:c9d2778e-8a9c-45f3-aca5-af5c4cfc112b for instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 on hv-cinder-82880 May 27 03:27:17.208631 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-97a690fc-4c09-4911-80d4-38962fa7b95a req-8cd693c6-17e5-4e7f-adcb-992164137bbc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028676 May 27 03:27:17.209189 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 223/462] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:17.230825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:17.231428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:17.237902 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:17.238343 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:17.239095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:17.239524 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:17.364290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:17.371644 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-790b92b9-8bb2-4c12-b63a-1af83e7d5bea tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.144592 May 27 03:27:17.372242 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 240/463] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:17 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:17.632988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:17.633676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:17.639865 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:17.640313 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:17.641063 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:17.641494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:17.768892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:17.777420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:17.778915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:17.780086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bf9ecade-64da-4dea-9f09-cdce48985446 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.151891 May 27 03:27:17.780648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 224/464] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:17 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:18.108730 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:18.109346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:18.115900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:18.116344 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:18.117087 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:18.117513 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:18.258359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:18.266054 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-42d951f6-cf7b-442b-8846-a1621803215c tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1319 microversion: 2.1 time: 0.161188 May 27 03:27:18.266630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 241/465] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:18 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:18.389066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:18.389586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:18.396123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:18.396561 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:18.397308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:18.397734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:18.721900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:18.729317 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d397167a-28d1-49ba-a8e4-83f79a9b7d66 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.344161 May 27 03:27:18.729887 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 225/466] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:18 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:18.798826 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:18.799423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:18.805626 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:18.806412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:18.807845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:18.808517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:18.942285 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:18.951127 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:18.953462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:18.955069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9c82f6de-00f2-435b-870f-f245b1ff721d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.160629 May 27 03:27:18.955919 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 242/467] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:18 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:19.282333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:19.283453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:19.289409 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.289849 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.290593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.291017 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.547504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:19.554942 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c9f7d139-2b40-4a67-aa0f-14d8884325fb tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1319 microversion: 2.1 time: 0.276416 May 27 03:27:19.555529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 226/468] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:19 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:19.746451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:19.747050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:19.753645 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.754086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.754837 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.755262 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.889529 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:19.897722 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c76bad73-7b18-43ec-815a-b5d6630f1af4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.155069 May 27 03:27:19.898286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 243/469] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:19 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:19.973314 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:19.974045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:19.980702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.981153 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.981908 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.982399 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.009944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-684e018f-7d3b-4aa5-9d5f-0c022f8e16c7 req-9d730c2e-c257-4631-b02b-ec2c416cbe9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3861273f-f82d-46bd-b0c7-ce36e0a9e7f9", "name": "network-vif-plugged", "status": "completed", "tag": "c9d2778e-8a9c-45f3-aca5-af5c4cfc112b"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:20.019679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-684e018f-7d3b-4aa5-9d5f-0c022f8e16c7 req-9d730c2e-c257-4631-b02b-ec2c416cbe9e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.020319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-684e018f-7d3b-4aa5-9d5f-0c022f8e16c7 req-9d730c2e-c257-4631-b02b-ec2c416cbe9e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.032117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-684e018f-7d3b-4aa5-9d5f-0c022f8e16c7 req-9d730c2e-c257-4631-b02b-ec2c416cbe9e service nova] Creating event network-vif-plugged:c9d2778e-8a9c-45f3-aca5-af5c4cfc112b for instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 on hv-cinder-82880 May 27 03:27:20.037149 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-684e018f-7d3b-4aa5-9d5f-0c022f8e16c7 req-9d730c2e-c257-4631-b02b-ec2c416cbe9e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031087 May 27 03:27:20.037987 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 244/470] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:27:20.119780 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:20.129105 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:20.130633 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:20.131802 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0aef8f45-5bdd-4c63-a189-cbf83ae70b6e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.162736 May 27 03:27:20.132387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 227/471] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:19 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:20.571315 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:20.571955 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:20.578360 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.578804 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.580212 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.580643 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.710144 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:20.717490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2c1032a1-3a0d-4eda-b3f2-54f27d95ecac tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1319 microversion: 2.1 time: 0.150466 May 27 03:27:20.718058 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 245/472] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:20 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:20.914414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:20.915021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:20.917018 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:20.917671 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:20.924305 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.924756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.925552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.925988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.052549 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:21.059985 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-51a764ce-4795-41b6-bcb8-86dcbbf841c3 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.149367 May 27 03:27:21.060546 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 228/473] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:20 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:21.151032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:21.151631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:21.154012 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:21.159378 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.159842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.160595 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.161028 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.287352 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:21.295814 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:21.297337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:21.299005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fd4836ac-0944-4f85-a730-902c666bb8b0 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.151806 May 27 03:27:21.299863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 246/474] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:21 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:21.734106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:21.734721 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:21.736618 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:21.742025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.742472 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.743229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.743659 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.882805 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:21.890881 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-81a78c4c-5571-4dd3-8a63-73fb0e5706a9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1319 microversion: 2.1 time: 0.160574 May 27 03:27:21.891445 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 229/475] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:21 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:22.058837 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-38a5d321-6a07-4a61-abb4-6adef1768812 req-93d4d222-1fb0-44b7-ac95-c9874158dbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668956ce-1a9e-43d1-a8d9-6ed759ad30f3", "name": "network-vif-plugged", "status": "completed", "tag": "906f93e1-97e9-4418-8ad2-066ad5cfe98a"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:22.067500 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-38a5d321-6a07-4a61-abb4-6adef1768812 req-93d4d222-1fb0-44b7-ac95-c9874158dbb7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.067968 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-38a5d321-6a07-4a61-abb4-6adef1768812 req-93d4d222-1fb0-44b7-ac95-c9874158dbb7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.077693 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:22.078372 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:22.078960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-38a5d321-6a07-4a61-abb4-6adef1768812 req-93d4d222-1fb0-44b7-ac95-c9874158dbb7 service nova] Creating event network-vif-plugged:906f93e1-97e9-4418-8ad2-066ad5cfe98a for instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 on hv-cinder-82880 May 27 03:27:22.084480 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-38a5d321-6a07-4a61-abb4-6adef1768812 req-93d4d222-1fb0-44b7-ac95-c9874158dbb7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029251 May 27 03:27:22.085364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 247/476] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:22.085537 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.086003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.086761 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.087248 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.221050 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:22.228888 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0b97041b-ff65-4d52-be04-13f880bb8204 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.155138 May 27 03:27:22.229535 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 230/477] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:22 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:22.319107 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:22.319727 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:22.327036 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.327488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.328284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.328729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.344083 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:22.462864 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:22.471449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:22.473064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:22.474219 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-76655014-ad1a-4de4-a6ef-836769b2b721 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.160959 May 27 03:27:22.474772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 248/478] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:22 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:22.908103 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:22.908734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:22.914706 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.915161 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.915955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.916393 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.042914 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:23.050408 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bd0ebf96-7b08-47e3-8a17-4cfa5bf2a414 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1507 microversion: 2.1 time: 0.146209 May 27 03:27:23.050973 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 231/479] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:22 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:23.067006 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-86738eaa-b4f4-4bfd-ab17-560560fa6c7f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2315d918-5778-493c-87f2-c11c181ceb59", "device": "/dev/sdb"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:23.068111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-86738eaa-b4f4-4bfd-ab17-560560fa6c7f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:23.074363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86738eaa-b4f4-4bfd-ab17-560560fa6c7f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.074804 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86738eaa-b4f4-4bfd-ab17-560560fa6c7f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.075547 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86738eaa-b4f4-4bfd-ab17-560560fa6c7f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.076001 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86738eaa-b4f4-4bfd-ab17-560560fa6c7f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.244935 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:23.245544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:23.252730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.253177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.253936 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.254371 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.393392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:23.401159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9e65376b-80a6-49c7-83ea-ce9c78b83d82 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.160004 May 27 03:27:23.401821 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 232/480] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:23 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:23.453929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-86738eaa-b4f4-4bfd-ab17-560560fa6c7f tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "POST /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391137 May 27 03:27:23.454471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 249/481] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:27:23 2022] POST /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:23.492441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:23.493045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:23.498975 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.499411 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.500275 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.500836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.627603 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:23.635988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:23.637469 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:23.638610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-cef833ff-68f2-4ab4-92cf-681c69591c5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.150023 May 27 03:27:23.639174 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 233/482] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:23 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:24.419468 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:24.420234 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.426453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.426895 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.427648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.428104 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.557453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:24.565412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ff29a4c9-aad7-433c-b3fc-d524d8a1a6b1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.150634 May 27 03:27:24.565963 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 250/483] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:24 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:24.656288 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:24.656891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.663281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.663726 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.664504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.664936 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.789769 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:24.798575 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:24.800077 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:24.801214 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-cd04ec97-f615-4bda-a06a-9130bd8fb3dc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.148736 May 27 03:27:24.801759 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 234/484] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:24 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:25.582948 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:25.583707 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:25.590182 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.590738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.591606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.592125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.731556 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:25.739206 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0cd2f0a6-377c-4110-ad24-fc7af2c218d7 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.160828 May 27 03:27:25.739793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 251/485] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:25 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:25.819364 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:25.820544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:25.827147 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.827590 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.828378 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.828806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.969316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:25.977914 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:25.979621 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:25.980774 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f8899cf7-d995-4811-a21d-68b4925857ca tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1808 microversion: 2.20 time: 0.165410 May 27 03:27:25.981323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 235/486] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:25 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:26.756689 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:26.757202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:26.763636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:26.764112 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:26.764872 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:26.765304 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:26.892339 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:26.900353 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-17649918-0db6-474e-a4fe-b404d7b04632 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.148350 May 27 03:27:26.900919 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 252/487] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:26 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:26.998378 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:26.998986 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:27.006144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:27.006592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:27.007429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:27.007840 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:27.011760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:27.134715 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:27.142924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:27.144422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:27.145674 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6e5baa1c-7733-4179-b60c-441dde144d68 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1795 microversion: 2.20 time: 0.151098 May 27 03:27:27.146122 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 236/488] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:27:26 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1795 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:27.916644 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:27.917345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:27.924123 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:27.924538 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:27.925301 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:27.925731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.052922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:28.060315 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-acdfb0f9-09b3-4cba-8d88-077710358c5c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.147496 May 27 03:27:28.060876 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 253/489] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:27 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:29.077605 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:29.078212 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:29.085258 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.085704 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.086452 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.086879 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.218161 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:29.225723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f653fb04-6496-4ae4-b082-f2fdee4304db tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.152154 May 27 03:27:29.226282 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 237/490] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:29 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:29.876319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-bf7d2932-b1b9-4384-9264-e9b5ef031335 req-d077a6f8-d507-4513-a850-9ac5740442b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46fbddd-5f15-41b9-aaab-7fe260aa7bcd", "name": "network-vif-plugged", "status": "completed", "tag": "71e11d00-d642-48e1-acfd-a532d0199408"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:29.889616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-bf7d2932-b1b9-4384-9264-e9b5ef031335 req-d077a6f8-d507-4513-a850-9ac5740442b8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.890130 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-bf7d2932-b1b9-4384-9264-e9b5ef031335 req-d077a6f8-d507-4513-a850-9ac5740442b8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.902563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-bf7d2932-b1b9-4384-9264-e9b5ef031335 req-d077a6f8-d507-4513-a850-9ac5740442b8 service nova] Creating event network-vif-plugged:71e11d00-d642-48e1-acfd-a532d0199408 for instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd on hv-cinder-82880 May 27 03:27:29.907963 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-bf7d2932-b1b9-4384-9264-e9b5ef031335 req-d077a6f8-d507-4513-a850-9ac5740442b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035890 May 27 03:27:29.917280 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 254/491] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:30.241898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:30.242524 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:30.249217 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:30.249667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:30.250443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:30.250884 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:30.379681 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:30.387309 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-44644f1d-361a-4d33-b97a-75388114a355 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.149250 May 27 03:27:30.387890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 238/492] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:30 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:31.405172 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:31.405885 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:31.413315 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:31.413757 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:31.414502 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:31.414927 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:31.548532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:31.556047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-59ec9465-46e4-4660-bb24-43200ceb4775 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1259 microversion: 2.1 time: 0.154980 May 27 03:27:31.556612 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 255/493] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:31 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:32.573496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:32.574178 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:32.580713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.581192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.581919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.582352 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.717995 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:32.725472 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-dd9cb36a-dd14-46d7-9982-7fd3940510d8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1442 microversion: 2.1 time: 0.156042 May 27 03:27:32.726037 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 239/494] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:32 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:32.742222 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:32.742828 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:32.749206 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.749672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.750419 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.750841 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.879610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:32.888416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0fd344e8-207f-4749-98b6-be2262377a01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1442 microversion: 2.1 time: 0.149895 May 27 03:27:32.888988 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 256/495] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:32 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:34.633647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-94850e8a-111d-4885-b1c5-460276ff1b20 req-ffe79ce5-40ef-4611-afa4-c9b1391acc9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46fbddd-5f15-41b9-aaab-7fe260aa7bcd", "tag": "71e11d00-d642-48e1-acfd-a532d0199408"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:34.642128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-94850e8a-111d-4885-b1c5-460276ff1b20 req-ffe79ce5-40ef-4611-afa4-c9b1391acc9f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:34.643171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-94850e8a-111d-4885-b1c5-460276ff1b20 req-ffe79ce5-40ef-4611-afa4-c9b1391acc9f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:34.654046 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-94850e8a-111d-4885-b1c5-460276ff1b20 req-ffe79ce5-40ef-4611-afa4-c9b1391acc9f service nova] Creating event network-changed:71e11d00-d642-48e1-acfd-a532d0199408 for instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd on hv-cinder-82880 May 27 03:27:34.659004 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-94850e8a-111d-4885-b1c5-460276ff1b20 req-ffe79ce5-40ef-4611-afa4-c9b1391acc9f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029014 May 27 03:27:34.659592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 240/496] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:45.168538 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:45.169115 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:45.171756 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=41 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:45.172430 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:45.178440 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.178886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:45.179641 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.180102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:45.259588 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lazy-loading 'services' on Instance uuid 15a8db13-6978-4562-918e-29f8ca94ef3f {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:45.329358 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-88b5f32a-f7e4-441d-b4fe-36964c1aca8d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-volume_attachments/1ea23c1c-da88-43f2-ae71-3909fd2ac4b9" status: 202 len: 0 microversion: 2.1 time: 0.164599 May 27 03:27:45.329966 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 257/497] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:27:45 2022] DELETE /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-volume_attachments/1ea23c1c-da88-43f2-ae71-3909fd2ac4b9 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:45.913129 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=23 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:45.913866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=24 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:45.918422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:45.919001 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:45.926675 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.927123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:45.927902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.928333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:46.049678 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lazy-loading 'services' on Instance uuid 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:46.160393 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-39def635-583f-402a-bd5d-63753e9e01b9 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9/os-volume_attachments/2315d918-5778-493c-87f2-c11c181ceb59" status: 202 len: 0 microversion: 2.1 time: 0.249033 May 27 03:27:46.160970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 241/498] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:27:45 2022] DELETE /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9/os-volume_attachments/2315d918-5778-493c-87f2-c11c181ceb59 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:47.498403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-64257f33-92f2-4ff9-920a-d9431179087f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:47.505197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64257f33-92f2-4ff9-920a-d9431179087f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.505645 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64257f33-92f2-4ff9-920a-d9431179087f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.581981 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-64257f33-92f2-4ff9-920a-d9431179087f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Going to try to stop instance {{(pid=117610) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 03:27:47.623673 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-64257f33-92f2-4ff9-920a-d9431179087f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action" status: 202 len: 0 microversion: 2.1 time: 0.129782 May 27 03:27:47.624338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 258/499] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:27:47 2022] POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:47.634265 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:47.635126 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:47.641745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.642429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.643249 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.643711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.771740 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:47.779443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1b12a8ae-9f6b-4ce2-8916-0df5549ff07b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.149999 May 27 03:27:47.780042 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 242/500] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:47 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:48.330377 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:48.330949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:48.337739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.338174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.339005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.339432 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.365076 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:27:48.449646 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a864f2f8-4db5-4626-9436-02cd42d04970 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 204 len: 0 microversion: 2.1 time: 0.123619 May 27 03:27:48.450232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 259/501] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:27:48 2022] DELETE /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:27:48.458836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:48.459431 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:48.465363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.465798 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.466539 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.466960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.597808 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:48.605203 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9c55d92b-cb47-4afd-ab25-04859555885d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1513 microversion: 2.1 time: 0.150626 May 27 03:27:48.605759 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 243/502] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:48 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:48.796791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:48.797434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:48.803921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.804371 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.805118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.805543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:49.134103 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:49.141549 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4192cadb-98fb-42a0-ba96-e503db7a7703 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.348947 May 27 03:27:49.142119 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 260/503] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:48 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:49.621771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:49.622374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:49.629383 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:49.629829 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:49.630577 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:49.631003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:49.760667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:49.768700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9f9c6cd8-71c7-42f2-96e5-c827b5b6b90d tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1513 microversion: 2.1 time: 0.150698 May 27 03:27:49.769271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 244/504] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:49 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:50.160127 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:50.160729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:50.167137 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.167575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.168345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.168775 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.295443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:50.302803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ae4b7a54-2cd4-4bcb-9e17-f57a8707ac6b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.147111 May 27 03:27:50.303392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 261/505] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:50 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:50.786249 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:50.786863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:50.793639 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.794090 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.794863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.795301 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.994927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9bfcb74bc14e92b96e4169ed323399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee9b49e32b848e2a75facdeef1aa8a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:51.002749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1b0be498-b389-467c-8e83-316dd059ea7e tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 200 len: 1513 microversion: 2.1 time: 0.220934 May 27 03:27:51.003316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 245/506] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:50 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:51.171026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-9cf21312-f7cf-451d-88b1-ff8b2bf837e3 req-bce94c70-dd0f-435d-83a6-bc061cc1c1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3861273f-f82d-46bd-b0c7-ce36e0a9e7f9", "name": "network-vif-deleted", "tag": "c9d2778e-8a9c-45f3-aca5-af5c4cfc112b"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:51.181929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-9cf21312-f7cf-451d-88b1-ff8b2bf837e3 req-bce94c70-dd0f-435d-83a6-bc061cc1c1dd service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.182375 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-9cf21312-f7cf-451d-88b1-ff8b2bf837e3 req-bce94c70-dd0f-435d-83a6-bc061cc1c1dd service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.193991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-9cf21312-f7cf-451d-88b1-ff8b2bf837e3 req-bce94c70-dd0f-435d-83a6-bc061cc1c1dd service nova] Creating event network-vif-deleted:c9d2778e-8a9c-45f3-aca5-af5c4cfc112b for instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 on hv-cinder-82880 May 27 03:27:51.199240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-9cf21312-f7cf-451d-88b1-ff8b2bf837e3 req-bce94c70-dd0f-435d-83a6-bc061cc1c1dd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032137 May 27 03:27:51.200132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 262/507] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:51.320911 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:51.321443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:51.327728 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.328207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.328967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.329397 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.458075 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:51.465683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6a1a6a26-756d-40e9-842d-bd4daa978312 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.148719 May 27 03:27:51.466244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 246/508] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:51 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:52.020111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:52.020735 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] [instance: 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:52.027657 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.028128 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.028876 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.029305 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.042610 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] HTTP exception thrown: Instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 could not be found. May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Request method failure captured: May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 HTTP/1.1 May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikESsWGpIepbtfpXAKWY-F9gLgmeb3J20yFbeUj6YmKD3kU_BPnjuWAoCWOUtiH4hgcUEqD_FX-FtszSNMVUJ94vARYhRNn3-Ei1-Dp-HqOUKgE23jGv37Ng_Hn2M2x_yVW-Rmd9eVw9dHerSDrec_zbD5WzGVkjpUyutTx8c_PEsGPg May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: aee9b49e32b848e2a75facdeef1aa8a5 May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-VolumesSnapshotTestJSON-77916036 May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:27:52.044241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aee9b49e32b848e2a75facdeef1aa8a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aee9b49e32b848e2a75facdeef1aa8a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aee9b49e32b848e2a75facdeef1aa8a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aee9b49e32b848e2a75facdeef1aa8a5"}]}] May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-VolumesSnapshotTestJSON-77916036 May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: aee9b49e32b848e2a75facdeef1aa8a5 May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-77916036 May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-VolumesSnapshotTestJSON-77916036-project May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 8b9bfcb74bc14e92b96e4169ed323399 May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-VolumesSnapshotTestJSON-77916036-project May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 could not be found. May 27 03:27:52.045776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '3861273f-f82d-46bd-b0c7-ce36e0a9e7f9'} May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 could not be found. May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:52.046683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 could not be found. May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 could not be found. May 27 03:27:52.048899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:27:52.050205 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] Returning 404 to user: Instance 3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:52.050205 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-54c9fcbe-d31f-4484-ad90-9db81bfd9872 tempest-VolumesSnapshotTestJSON-77916036 tempest-VolumesSnapshotTestJSON-77916036-project] 10.222.0.62 "GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9" status: 404 len: 111 microversion: 2.1 time: 0.029785 May 27 03:27:52.050205 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 263/509] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:52 2022] GET /compute/v2.1/servers/3861273f-f82d-46bd-b0c7-ce36e0a9e7f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:27:52.482879 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:52.483484 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:52.490531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.490974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.491757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.492217 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.621681 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:52.629140 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ac60ce71-f37d-4d31-bd18-501db4b3500f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.150091 May 27 03:27:52.629699 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 247/510] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:52 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:53.576930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-95706cac-82ec-45c7-b425-d4f8918c4f61 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f06df9d5-ad98-4fe5-a56e-a7c91186b1cf"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:53.577941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-95706cac-82ec-45c7-b425-d4f8918c4f61 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:53.584377 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-95706cac-82ec-45c7-b425-d4f8918c4f61 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.584820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-95706cac-82ec-45c7-b425-d4f8918c4f61 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.585577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-95706cac-82ec-45c7-b425-d4f8918c4f61 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.586013 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-95706cac-82ec-45c7-b425-d4f8918c4f61 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.645448 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:53.646043 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:53.652099 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.652600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.653274 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.653702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.786592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:53.794981 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5e788dff-3a45-4a5b-806a-9daac24228eb tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.152918 May 27 03:27:53.795852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 248/511] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:53 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:53.855475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-95706cac-82ec-45c7-b425-d4f8918c4f61 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282424 May 27 03:27:53.856100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 264/512] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:27:53 2022] POST /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:54.814603 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:54.815118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:54.821537 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.821977 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.823054 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.823483 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.956498 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:54.964032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-95c54463-1df0-4785-9ea7-29f06d0dbaf0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.153847 May 27 03:27:54.964582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 249/513] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:54 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:55.981915 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:55.982617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:55.988833 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.989288 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.990046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.990478 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:56.121191 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:56.128633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8ba70a39-3699-4983-87d4-f11f3017040d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.151487 May 27 03:27:56.129190 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 265/514] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:55 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:57.144817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:57.145413 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:57.151806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.152260 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.153026 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.153428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.355652 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:57.363522 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d61824cf-d27d-4bb9-bcb8-68d0fbf24f3d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.222486 May 27 03:27:57.364117 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 250/515] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:57 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:58.381380 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:58.381907 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:58.388403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.388851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.389612 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.390044 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.527478 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:58.535512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-58a35ea3-28dc-4ecb-9f52-a62df4c0be77 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.158526 May 27 03:27:58.536089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 266/516] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:58 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:59.553334 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:59.553933 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:59.560432 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:59.560866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:59.561611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:59.562033 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:59.693228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:59.700959 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f7c55914-909d-4370-ada9-b2a0777f82fd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.151934 May 27 03:27:59.701731 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 251/517] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:27:59 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:00.718010 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:00.718652 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:00.725960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:00.726428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:00.727178 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:00.727604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:00.857980 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:00.865975 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-05cc05d6-5bf4-4c54-b948-9bc534a69c41 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.151786 May 27 03:28:00.866537 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 267/518] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:00 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:01.882956 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:01.883550 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:01.890007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:01.890442 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:01.891181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:01.891606 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:02.016683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:02.024086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f3e89f7b-25b6-4ed7-a367-8bdce9cfd004 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.144962 May 27 03:28:02.024649 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 252/519] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:01 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:03.041422 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:03.042024 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:03.048469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:03.048912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:03.049656 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:03.050084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:03.176957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:03.184353 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c669599c-8774-44f1-9caf-6a33594bde2c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.146822 May 27 03:28:03.184904 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 268/520] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:03 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:04.202319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:04.202852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:04.209859 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:04.210326 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:04.211116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:04.211548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:04.336081 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:04.343450 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4a4e4b74-f650-427a-97cf-e35c6f91f11e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.145086 May 27 03:28:04.344048 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 253/521] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:04 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:05.360236 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:05.360839 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:05.367962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.368405 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:05.369146 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.369574 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:05.497042 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:05.502562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-99abf6d7-4847-4ad3-a698-54e697186104 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.146147 May 27 03:28:05.503115 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 269/522] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:05 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:06.519270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:06.519987 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:06.526420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.526867 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.527623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.528082 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.617064 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:06.618057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:06.624961 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.625515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.626345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.626822 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.631374 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:06.652324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lazy-loading 'flavor' on Instance uuid bbe5601a-821f-42fb-8ad4-090c4640928d {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:06.664245 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:06.671843 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f2cfb180-6f06-4695-8d1b-c5667415673e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.156281 May 27 03:28:06.672429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 254/523] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:06 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:06.778942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-50011f9f-3cf5-46d2-b884-5205b4ab8918 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/action" status: 200 len: 32 microversion: 2.1 time: 0.165705 May 27 03:28:06.779465 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 270/524] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:28:06 2022] POST /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:28:06.788986 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:06.789597 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:06.795645 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.796126 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.796895 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.797332 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.010824 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:07.019261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6045395b-dd99-4111-8629-a70de0901f58 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.234118 May 27 03:28:07.019846 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 255/525] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:06 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:07.691790 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:07.692535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:07.699285 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:07.699726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.700499 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:07.700928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.836331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:07.843772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-58f4cd7a-d809-4079-b115-c8a996d4ab13 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1677 microversion: 2.1 time: 0.157181 May 27 03:28:07.844359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 271/526] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:07 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:08.037158 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:08.037769 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:08.044328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.044779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.045540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.046002 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.173895 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:08.177684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:08.182870 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-191c18ab-e614-4454-826a-dbc98cd59420 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.150131 May 27 03:28:08.183445 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 256/527] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:08 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:08.862457 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:08.863060 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:08.869514 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.869960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.870713 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.871141 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.997356 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:09.004892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6c9eb694-d72d-4af5-81be-279e5df5d09d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1654 microversion: 2.1 time: 0.146729 May 27 03:28:09.005450 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 272/528] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:08 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:09.020887 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b0ad5bc0-fade-4ea9-b998-7485ce01c4dd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:09.027988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b0ad5bc0-fade-4ea9-b998-7485ce01c4dd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.028322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b0ad5bc0-fade-4ea9-b998-7485ce01c4dd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.050703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b0ad5bc0-fade-4ea9-b998-7485ce01c4dd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Going to try to start instance {{(pid=117609) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 03:28:09.090533 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b0ad5bc0-fade-4ea9-b998-7485ce01c4dd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action" status: 202 len: 0 microversion: 2.1 time: 0.073275 May 27 03:28:09.091118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 257/529] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:28:09 2022] POST /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:28:09.100314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:09.100949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:09.107276 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.107910 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.108809 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.109346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.200976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:09.201670 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:09.208601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.209297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.210078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.210518 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.244757 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:09.253165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a36037ad-5900-483b-a886-723b41c03301 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1663 microversion: 2.1 time: 0.157932 May 27 03:28:09.253743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 273/530] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:09 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:09.412199 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:09.420191 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3f78fde7-7a4c-4494-a24c-97920a1549f9 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.223662 May 27 03:28:09.420757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 258/531] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:09 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:10.271084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.271691 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:10.278216 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.278664 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.279416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.279873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.413811 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:10.421701 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3479d418-c3f0-4f30-9d95-a3e9fee3e5f1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1663 microversion: 2.1 time: 0.155000 May 27 03:28:10.422464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 274/532] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:10.437492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.438205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:10.445504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.445940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.446955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.447355 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.572970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:10.581499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-40205660-8ba5-491b-9a83-250d0dad7940 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.147754 May 27 03:28:10.582063 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 259/533] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:11.438558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.439214 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:11.445819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.446264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.447273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.447704 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.572746 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:11.580613 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b67b8960-fb71-4890-8134-88d2ab265282 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1667 microversion: 2.1 time: 0.145426 May 27 03:28:11.581179 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 275/534] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1667 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:11.598885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.599490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:11.605804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.606245 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.606989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.607417 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.733314 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:11.741561 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-482c2e55-7335-410a-8a74-a8bf8d90070b tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.147068 May 27 03:28:11.742166 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 260/535] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:12.758478 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.759109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:12.765643 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.766091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:12.766847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.767284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:12.897852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:12.906084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-110b0b2c-e157-4eff-8ca0-c012e775ce1e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.151413 May 27 03:28:12.906646 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 276/536] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:13.923214 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:13.923868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:13.930314 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:13.930758 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:13.931503 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:13.931958 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.059773 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:14.067606 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0efadf1e-a002-460b-b54c-b2ca8b464a48 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.148155 May 27 03:28:14.068190 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 261/537] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:13 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:14.954084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9ce55b46-903d-4f28-8c5f-fb9ac97ba78d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:14.954599 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9ce55b46-903d-4f28-8c5f-fb9ac97ba78d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:14.961879 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ce55b46-903d-4f28-8c5f-fb9ac97ba78d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.962349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ce55b46-903d-4f28-8c5f-fb9ac97ba78d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.963108 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ce55b46-903d-4f28-8c5f-fb9ac97ba78d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.963549 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ce55b46-903d-4f28-8c5f-fb9ac97ba78d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.991204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9ce55b46-903d-4f28-8c5f-fb9ac97ba78d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments/929668c0-545c-448f-ac98-4d66db656172" status: 200 len: 194 microversion: 2.20 time: 0.041068 May 27 03:28:14.991778 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 277/538] 10.222.0.62 () {60 vars in 1453 bytes} [Fri May 27 03:28:14 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments/929668c0-545c-448f-ac98-4d66db656172 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:28:15.061755 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:15.062275 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:15.069385 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.069828 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.070582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.071012 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.085180 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:15.085788 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:15.091790 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.092269 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.093032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.093469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.155000 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lazy-loading 'services' on Instance uuid 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:15.224834 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:15.225306 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-89dbbb1e-bf28-4d18-8389-227e381f8efc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments/929668c0-545c-448f-ac98-4d66db656172" status: 202 len: 0 microversion: 2.20 time: 0.167223 May 27 03:28:15.225998 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 262/539] 10.222.0.62 () {60 vars in 1456 bytes} [Fri May 27 03:28:15 2022] DELETE /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments/929668c0-545c-448f-ac98-4d66db656172 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:28:15.232996 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e6717224-c6b0-41a6-a237-001e4f1f60e0 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.151515 May 27 03:28:15.233792 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 278/540] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:15 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:15.243266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ff1364fa-29d4-409b-a756-d8d74e321b0d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:15.244429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ff1364fa-29d4-409b-a756-d8d74e321b0d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:15.253790 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ff1364fa-29d4-409b-a756-d8d74e321b0d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.254245 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ff1364fa-29d4-409b-a756-d8d74e321b0d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.255061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ff1364fa-29d4-409b-a756-d8d74e321b0d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.255568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ff1364fa-29d4-409b-a756-d8d74e321b0d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.285818 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ff1364fa-29d4-409b-a756-d8d74e321b0d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055155 May 27 03:28:15.286377 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 263/541] 10.222.0.62 () {60 vars in 1342 bytes} [Fri May 27 03:28:15 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:28:16.251916 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:16.252508 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:16.254931 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:16.260684 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.261131 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.261896 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.262329 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.297472 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ab75cb7e-82b5-4aca-9403-a07bf5d45fea tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:16.299164 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ab75cb7e-82b5-4aca-9403-a07bf5d45fea tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:16.301732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=47 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:16.307868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab75cb7e-82b5-4aca-9403-a07bf5d45fea tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.308078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab75cb7e-82b5-4aca-9403-a07bf5d45fea tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.308691 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab75cb7e-82b5-4aca-9403-a07bf5d45fea tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.309117 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ab75cb7e-82b5-4aca-9403-a07bf5d45fea tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.339136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ab75cb7e-82b5-4aca-9403-a07bf5d45fea tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045514 May 27 03:28:16.339695 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 264/542] 10.222.0.62 () {60 vars in 1342 bytes} [Fri May 27 03:28:16 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:16.403021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:16.404695 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:16.405910 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:16.411463 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a2fcf914-5843-483b-85b0-a19cab80e71a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.163346 May 27 03:28:16.412250 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 279/543] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:16 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:16.412384 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.412800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.413640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.414078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.442017 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:28:16.517285 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-464a0d0d-7cfe-4ef2-8cc6-2c024d46701e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 204 len: 0 microversion: 2.20 time: 0.116790 May 27 03:28:16.518375 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 265/544] 10.222.0.62 () {60 vars in 1279 bytes} [Fri May 27 03:28:16 2022] DELETE /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:28:16.526642 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:16.527490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:16.535236 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.535688 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.536488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.536927 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.671667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:16.678697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:16.680264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:16.681418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ce26dad3-a2c5-471a-8641-68d9cc1e0160 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.158631 May 27 03:28:16.681965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 280/545] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:16 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:17.429832 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:17.430630 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:17.436974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:17.437421 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:17.438310 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:17.438747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:17.592151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:17.601616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-be8090ea-414a-4663-96fb-afebcf6de407 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.175861 May 27 03:28:17.602982 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 266/546] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:17 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:17.700636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:17.701993 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:17.710433 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:17.710988 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:17.711922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:17.712423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:17.937899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:17.949090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:17.950623 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:17.952098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-1ccdf14c-1264-4e96-8e37-579612bfb6b7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.255804 May 27 03:28:17.952589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 281/547] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:17 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:18.618448 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:18.620164 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:18.628852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:18.629553 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:18.630495 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:18.631105 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:18.971041 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:18.972297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:18.979139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:18.979589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:18.980390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:18.980820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:19.070772 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.079792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9b92af1e-e72e-42f6-9222-500560d77e3a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.464825 May 27 03:28:19.090025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 267/548] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:18 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:19.445706 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.464738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.471173 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.472813 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a5e8904a-05b5-49e3-8efd-daaff7dabc0c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1723 microversion: 2.20 time: 0.506036 May 27 03:28:19.473342 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 282/549] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:18 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:20.070515 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-1bca3fb5-5d1a-47e3-8548-446ecf0c8d6c req-52ee63db-c02d-4829-a0d9-0c462c457dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668956ce-1a9e-43d1-a8d9-6ed759ad30f3", "name": "network-vif-deleted", "tag": "906f93e1-97e9-4418-8ad2-066ad5cfe98a"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:20.082426 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-1bca3fb5-5d1a-47e3-8548-446ecf0c8d6c req-52ee63db-c02d-4829-a0d9-0c462c457dfc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.083148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-1bca3fb5-5d1a-47e3-8548-446ecf0c8d6c req-52ee63db-c02d-4829-a0d9-0c462c457dfc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.096098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-1bca3fb5-5d1a-47e3-8548-446ecf0c8d6c req-52ee63db-c02d-4829-a0d9-0c462c457dfc service nova] Creating event network-vif-deleted:906f93e1-97e9-4418-8ad2-066ad5cfe98a for instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 on hv-cinder-82880 May 27 03:28:20.097578 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:20.098406 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:20.103642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-1bca3fb5-5d1a-47e3-8548-446ecf0c8d6c req-52ee63db-c02d-4829-a0d9-0c462c457dfc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037360 May 27 03:28:20.108877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 268/550] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:20.109595 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.111288 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.113462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.115258 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.486131 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.492753 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:20.493446 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:20.497624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bfa24768-a4de-4684-8a89-eb205c1be621 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.404531 May 27 03:28:20.498882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 283/551] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:20 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:20.506406 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.507676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.508647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.512544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.596516 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.597749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.598476 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lazy-loading 'fault' on Instance uuid 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:20.659811 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.676694 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.680015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.681451 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ffd7c8ad-8b24-4f3e-94cb-74a31391eed9 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 200 len: 1372 microversion: 2.20 time: 0.194094 May 27 03:28:20.692999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 269/552] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:20 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:28:21.516432 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:21.517094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:21.525944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.526387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.527161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.527706 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.703012 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:21.704511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:21.719712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.720952 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.723093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.723693 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.749319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] HTTP exception thrown: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Request method failure captured: May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 HTTP/1.1 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEROcAQPsnVyoFwkzR7ftYrwYY1jpz6iKJpM0ZObtCEcLg4xTW__8HYnghm_GhGIFc_rjC2HnbTXvbGoaIlUnEE-BKyhqBGBTPNwLYvFuORaqqRAYSJs1nqnvPJbWJgBblPm22trMduQZVZFkq-1ebJX6HhKCyLwt36Hopo9KOmdaw8 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 3931210010614a1f987661568f29e851 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:28:21.754504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3931210010614a1f987661568f29e851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3931210010614a1f987661568f29e851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}] May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 3931210010614a1f987661568f29e851 May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 720bd38555404aafa93db5ae49b13acf May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:28:21.756062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '668956ce-1a9e-43d1-a8d9-6ed759ad30f3'} May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:21.756826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:28:21.758024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:21.760253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Returning 404 to user: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:21.772057 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-517f4f9f-3c9a-4806-be61-9e44dfaa3d88 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 404 len: 111 microversion: 2.20 time: 0.068101 May 27 03:28:21.772733 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 270/553] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:21 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:28:21.792035 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-28ab3edf-f68f-4241-bc0e-bb2b1d3716ad tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '.version_select at 0x7f40c04b20d0>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:21.865030 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-28ab3edf-f68f-4241-bc0e-bb2b1d3716ad tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578402549" status: 204 len: 0 microversion: 2.20 time: 0.085350 May 27 03:28:21.866819 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 271/554] 10.222.0.62 () {60 vars in 1261 bytes} [Fri May 27 03:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578402549 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:28:21.921249 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:21.927326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:21.941526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c7776821-ebc3-4bfa-9f7a-38852246d6fa tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.422654 May 27 03:28:21.944781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 284/555] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:21 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:22.833493 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bc96102e-a143-496c-8181-fba97a66fccc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'create', calling method: .version_select at 0x7f40c04fbb80>, body: {"keypair": {"name": "tempest-keypair-960575419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzlVcDTWQ0ZuRCkEEpt88yZqbPjkSwxXng4Sff43bF57XR5YQ8mwZl3itc/AIUCc3SbNFFaBWEYXNAQ2sEN77456//69OhbpSn0JlL+AHMX2X/XIRzGfx/Gfq5OHaBFDQ=="}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:22.849289 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-bc96102e-a143-496c-8181-fba97a66fccc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for project 3931210010614a1f987661568f29e851. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:22.853219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-bc96102e-a143-496c-8181-fba97a66fccc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for user 720bd38555404aafa93db5ae49b13acf and project 3931210010614a1f987661568f29e851. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:22.880520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bc96102e-a143-496c-8181-fba97a66fccc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051725 May 27 03:28:22.881828 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 272/556] 10.222.0.62 () {62 vars in 1199 bytes} [Fri May 27 03:28:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 03:28:22.962546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:22.963172 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:22.971311 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:22.972498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:22.973456 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:22.974011 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.153031 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:23.162528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6a97d78b-aa36-4ec3-8e66-963521032f16 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.204729 May 27 03:28:23.163710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 285/557] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:22 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:24.180273 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:24.181021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:24.187591 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.188359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.189695 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.190528 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.195612 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:24.430592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:24.439877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3e7f5c10-8320-4a5f-8b81-ab1fe9081764 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.263343 May 27 03:28:24.440890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 273/558] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:24 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:25.082488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1962914926", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6e77ba9-a945-4d02-9449-8f38e42d0677"}], "security_groups": [{"name": "tempest-securitygroup--165772484"}], "key_name": "tempest-keypair-960575419", "user_data": "}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:25.198312 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] validate_networks() for [('a6e77ba9-a945-4d02-9449-8f38e42d0677', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:28:25.457818 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:25.458441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:25.465177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.465631 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.466438 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.472511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.765077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:28:25.765727 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:28:25.766355 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:28:25.767464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:28:25.768068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:28:25.779679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.780385 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.781353 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.783587 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.794472 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:25.804527 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e82f6467-71f1-47f8-a1c7-8ce45cf912b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1736 microversion: 2.1 time: 0.350679 May 27 03:28:25.814003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 274/559] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:25 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1736 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:25.853233 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for project 3931210010614a1f987661568f29e851. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:25.871578 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Getting quotas for user 720bd38555404aafa93db5ae49b13acf and project 3931210010614a1f987661568f29e851. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:25.885162 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:28:25.892820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:28:25.958585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2d33feda-bcc6-4bcc-9f86-d215b985780b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.880460 May 27 03:28:25.969317 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-18e4bf57-18f2-45df-89ef-d463f203c5d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:25.970042 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-18e4bf57-18f2-45df-89ef-d463f203c5d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:25.975290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 286/560] 10.222.0.62 () {62 vars in 1187 bytes} [Fri May 27 03:28:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 03:28:26.056654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-18e4bf57-18f2-45df-89ef-d463f203c5d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.068157 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-18e4bf57-18f2-45df-89ef-d463f203c5d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.074989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-18e4bf57-18f2-45df-89ef-d463f203c5d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.077785 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-18e4bf57-18f2-45df-89ef-d463f203c5d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1281 microversion: 2.20 time: 0.112405 May 27 03:28:26.078548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 275/561] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:25 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:26.835713 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:26.836464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:26.849090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:26.850013 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:26.851035 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:26.851680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.097927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:27.099169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:27.109485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.110067 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.110761 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.111198 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.208660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:27.219168 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b0292c42-c3d0-41fd-b72b-a6d39295bd2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1716 microversion: 2.1 time: 0.389852 May 27 03:28:27.247373 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 287/562] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:26 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1716 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:27.289181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:27.302586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:27.305418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:27.306534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3b01800c-e342-4b4a-82e8-884d99be038a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1333 microversion: 2.20 time: 0.213049 May 27 03:28:27.322143 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 276/563] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:27 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1333 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:28:27.454099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:27.454754 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:27.463834 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.466161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.467644 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.470466 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.731224 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] HTTP exception thrown: Cannot 'detach_volume' instance bbe5601a-821f-42fb-8ad4-090c4640928d while it is in vm_state rescued May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Request method failure captured: May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: DELETE /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments/f06df9d5-ad98-4fe5-a56e-a7c91186b1cf HTTP/1.1 May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERVtl-lSxtKnD-S3B2Xt4kgPJOU6kBuQN11Sb1FuqqwO7bW9rMo8vZlXCoft9Hft3VMLZjEDTzH86PwKcKGCJPa6ytczeEYBZPm36-d-4WdkLJghrsraT70FMuHLMbwzqklas-xxSkAGQKJLTz793uz5PUbIov7aDD6Sv2raCqF2GI May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:28:27.747731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}] May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: e8fddb1cf74d4135b41000f8a6293020 May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:28:27.749540 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Cannot 'detach_volume' instance bbe5601a-821f-42fb-8ad4-090c4640928d while it is in vm_state rescued May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'server_id': 'bbe5601a-821f-42fb-8ad4-090c4640928d', 'id': 'f06df9d5-ad98-4fe5-a56e-a7c91186b1cf'} May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bbe5601a-821f-42fb-8ad4-090c4640928d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:27.750367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bbe5601a-821f-42fb-8ad4-090c4640928d while it is in vm_state rescued May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bbe5601a-821f-42fb-8ad4-090c4640928d while it is in vm_state rescued May 27 03:28:27.752484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:28:27.753948 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Returning 409 to user: Cannot 'detach_volume' instance bbe5601a-821f-42fb-8ad4-090c4640928d while it is in vm_state rescued {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:27.761078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9267e37c-a02f-4855-819f-c92b0958f121 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments/f06df9d5-ad98-4fe5-a56e-a7c91186b1cf" status: 409 len: 152 microversion: 2.1 time: 0.311171 May 27 03:28:27.764812 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 288/564] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:28:27 2022] DELETE /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments/f06df9d5-ad98-4fe5-a56e-a7c91186b1cf => generated 152 bytes in 314 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 03:28:27.775450 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-21f5671f-c231-4229-b8f2-5b7ece175806 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:27.776457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-21f5671f-c231-4229-b8f2-5b7ece175806 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:27.787502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21f5671f-c231-4229-b8f2-5b7ece175806 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.790604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21f5671f-c231-4229-b8f2-5b7ece175806 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.791574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21f5671f-c231-4229-b8f2-5b7ece175806 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.792127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21f5671f-c231-4229-b8f2-5b7ece175806 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.003230 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-21f5671f-c231-4229-b8f2-5b7ece175806 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "POST /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/action" status: 202 len: 0 microversion: 2.1 time: 0.234355 May 27 03:28:28.007264 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 277/565] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:28:27 2022] POST /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:28:28.012355 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:28.013192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:28.024601 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:28.025062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.025854 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:28.026295 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.327974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:28.328601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:28.338315 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:28.341256 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.344069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:28.344727 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.350830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:28.359458 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fce422e7-fcff-44c6-94fc-c8b4b822256a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1724 microversion: 2.1 time: 0.350987 May 27 03:28:28.360850 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 289/566] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:28 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:28.501993 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:28.520041 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:28.523118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:28.525521 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e1422d2b-1164-45f2-9107-67ff31640241 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1339 microversion: 2.20 time: 0.202049 May 27 03:28:28.526680 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 278/567] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:28 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:28:29.122710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-df2ee48b-0c32-4de7-815c-5ea452468065 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Action: 'create', calling method: .version_select at 0x7f40c0c3a670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1096312396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZDy2feGpPF4QaArDOI8QPLpPLVGGP88PB/ejXzk/5K6ALqDWnuWV6eXJQvawcI3YnU259xXCs6mz8Apq1xg3+/Q7oFThVRnqtZqolJhoxHbXw5aKnImDfsOQM3rDLZuA=="}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:29.146838 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-df2ee48b-0c32-4de7-815c-5ea452468065 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:29.151324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-df2ee48b-0c32-4de7-815c-5ea452468065 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for user 5c8ad338eb7b47c18dcb86f287e28858 and project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:29.181365 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-df2ee48b-0c32-4de7-815c-5ea452468065 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.252579 May 27 03:28:29.182145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 290/568] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:28:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:29.378402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:29.382281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:29.394251 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.394703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.395485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.395948 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.547433 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:29.548809 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:29.561290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.562619 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.564369 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.565184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.599355 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:29.613065 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-88f223a7-069b-4a46-af14-3c92866ac6b4 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1724 microversion: 2.1 time: 0.238932 May 27 03:28:29.615298 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 279/569] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:29 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:29.784104 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:29.793617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:29.800296 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:29.804124 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7e364dfd-faa5-4cb4-882c-efa46778016b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.262072 May 27 03:28:29.805159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 291/570] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:29 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:30.632971 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:30.634255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:30.642955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:30.643620 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:30.644601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:30.645378 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:30.831577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:30.832864 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:30.845864 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:30.847281 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:30.848999 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:30.849630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:30.971953 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:30.993123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-11cd83d5-ace4-42a8-9468-415fe2869e4e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1724 microversion: 2.1 time: 0.364189 May 27 03:28:30.995438 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 280/571] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:30 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:31.040682 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:31.053495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:31.055965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:31.057146 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b2608bcf-2ed5-4960-a21c-e252593058fb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.236840 May 27 03:28:31.058150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 292/572] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:30 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:31.553416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-8d5df512-b4d8-4c60-a4e0-189c9994635a req-0db3fdff-b530-4145-bae8-54ae9f791b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d97624-4fe0-488b-a0f3-99774e529c62", "tag": "31e8a7b7-f72a-49ad-a5a2-2f8d16acd296"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:31.569692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8d5df512-b4d8-4c60-a4e0-189c9994635a req-0db3fdff-b530-4145-bae8-54ae9f791b68 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:31.570153 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8d5df512-b4d8-4c60-a4e0-189c9994635a req-0db3fdff-b530-4145-bae8-54ae9f791b68 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:31.584469 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-8d5df512-b4d8-4c60-a4e0-189c9994635a req-0db3fdff-b530-4145-bae8-54ae9f791b68 service nova] Creating event network-changed:31e8a7b7-f72a-49ad-a5a2-2f8d16acd296 for instance f7d97624-4fe0-488b-a0f3-99774e529c62 on hv-cinder-82880 May 27 03:28:31.589612 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-8d5df512-b4d8-4c60-a4e0-189c9994635a req-0db3fdff-b530-4145-bae8-54ae9f791b68 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040249 May 27 03:28:31.590386 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 281/573] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:32.012463 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:32.013095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:32.019984 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.020344 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.021116 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.021546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.098899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:32.115096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:32.122665 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.123169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.124087 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.125586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.212925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:32.230036 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9d42e122-d326-46f8-80a1-336452ca9802 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1730 microversion: 2.1 time: 0.220503 May 27 03:28:32.235694 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 293/574] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:32 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:32.251579 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6603795b-72b6-46e8-ba80-9ebba9b6f637 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:32.254198 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6603795b-72b6-46e8-ba80-9ebba9b6f637 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:32.266046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6603795b-72b6-46e8-ba80-9ebba9b6f637 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.266697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6603795b-72b6-46e8-ba80-9ebba9b6f637 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.267637 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6603795b-72b6-46e8-ba80-9ebba9b6f637 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.268298 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6603795b-72b6-46e8-ba80-9ebba9b6f637 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.320893 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:32.329591 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:32.331078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:32.332336 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-79cb7cff-a814-4361-861c-c70d8f08dd67 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.260815 May 27 03:28:32.333236 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 282/575] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:32 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:32.365454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6603795b-72b6-46e8-ba80-9ebba9b6f637 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118152 May 27 03:28:32.366298 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 294/576] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:28:32 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:28:33.353179 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:33.354380 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:33.362241 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:33.363207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:33.364407 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:33.365101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:33.570936 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-c3204008-bb32-4383-a4bc-a835a040a857 req-e8e3fe3b-789f-4f50-991f-551546a61cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe5601a-821f-42fb-8ad4-090c4640928d", "tag": "f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:33.581201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c3204008-bb32-4383-a4bc-a835a040a857 req-e8e3fe3b-789f-4f50-991f-551546a61cbe service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:33.581889 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c3204008-bb32-4383-a4bc-a835a040a857 req-e8e3fe3b-789f-4f50-991f-551546a61cbe service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:33.595387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-c3204008-bb32-4383-a4bc-a835a040a857 req-e8e3fe3b-789f-4f50-991f-551546a61cbe service nova] Creating event network-changed:f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2 for instance bbe5601a-821f-42fb-8ad4-090c4640928d on hv-cinder-82880 May 27 03:28:33.601261 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-c3204008-bb32-4383-a4bc-a835a040a857 req-e8e3fe3b-789f-4f50-991f-551546a61cbe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036223 May 27 03:28:33.602076 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 295/577] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:28:33.942664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:33.954823 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:33.957370 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:33.958963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3bc50611-8247-4ee6-8c35-0a59bea6316b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.612080 May 27 03:28:33.963931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 283/578] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:33 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:34.977925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:34.978707 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:34.986177 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.986631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:34.987387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.987836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:35.118137 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:35.127039 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:35.128581 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:35.129683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ace1fa46-7e10-43e2-9ecb-2757082503da tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.156125 May 27 03:28:35.130237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 296/579] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:34 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:35.627024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-085a3a38-6e20-4dc6-b531-ce9f04a1aed0 req-4e18ca70-81a2-4d7c-9934-80ce05a21406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe5601a-821f-42fb-8ad4-090c4640928d", "tag": "f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:35.635656 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-085a3a38-6e20-4dc6-b531-ce9f04a1aed0 req-4e18ca70-81a2-4d7c-9934-80ce05a21406 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:35.636120 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-085a3a38-6e20-4dc6-b531-ce9f04a1aed0 req-4e18ca70-81a2-4d7c-9934-80ce05a21406 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:35.647173 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-085a3a38-6e20-4dc6-b531-ce9f04a1aed0 req-4e18ca70-81a2-4d7c-9934-80ce05a21406 service nova] Creating event network-changed:f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2 for instance bbe5601a-821f-42fb-8ad4-090c4640928d on hv-cinder-82880 May 27 03:28:35.652092 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-085a3a38-6e20-4dc6-b531-ce9f04a1aed0 req-4e18ca70-81a2-4d7c-9934-80ce05a21406 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028697 May 27 03:28:35.652670 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 284/580] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:36.147950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:36.148555 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:36.150494 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:36.156853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.157303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.158069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.158502 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.292928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:36.301945 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:36.303447 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:36.304617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-316091c8-a3a3-42ef-928e-f14586531e6f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.160561 May 27 03:28:36.305160 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 297/581] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:36 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:36.840413 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:36.845282 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-2dcab722-9584-419c-9079-98f87bfa6452 req-224cfb42-ac70-4771-aad1-5959b0b323b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d97624-4fe0-488b-a0f3-99774e529c62", "name": "network-vif-plugged", "status": "completed", "tag": "31e8a7b7-f72a-49ad-a5a2-2f8d16acd296"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:36.854324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2dcab722-9584-419c-9079-98f87bfa6452 req-224cfb42-ac70-4771-aad1-5959b0b323b1 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.854766 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2dcab722-9584-419c-9079-98f87bfa6452 req-224cfb42-ac70-4771-aad1-5959b0b323b1 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.865880 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-2dcab722-9584-419c-9079-98f87bfa6452 req-224cfb42-ac70-4771-aad1-5959b0b323b1 service nova] Creating event network-vif-plugged:31e8a7b7-f72a-49ad-a5a2-2f8d16acd296 for instance f7d97624-4fe0-488b-a0f3-99774e529c62 on hv-cinder-82880 May 27 03:28:36.870532 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-2dcab722-9584-419c-9079-98f87bfa6452 req-224cfb42-ac70-4771-aad1-5959b0b323b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031079 May 27 03:28:36.871114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 285/582] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:37.322752 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:37.323289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:37.329953 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.330416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.331204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.331652 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.461561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:37.470050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:37.471538 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:37.472652 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ddc6d6d9-8c47-443a-98e6-1ea820c7d7fe tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.154206 May 27 03:28:37.473192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 298/583] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:37 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:28:38.492359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:38.493058 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:38.499525 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.500677 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.501457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.501881 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.637463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:38.645324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:38.646841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:38.648002 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8bb545cf-d12d-4160-8ac2-9998e471fe9b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1406 microversion: 2.20 time: 0.160677 May 27 03:28:38.648572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 286/584] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:38 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:39.665621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:39.666228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:39.668561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=10 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:39.673897 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:39.674369 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:39.675096 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:39.675527 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:39.806031 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:39.816010 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:39.817522 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:39.818702 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-381d1e10-5303-47e9-a713-c6132d7ea3c7 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1597 microversion: 2.20 time: 0.156981 May 27 03:28:39.819231 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 299/585] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:28:39 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:39.836410 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-829386c1-9243-4f30-8840-13b03dd67254 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:39.836953 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-829386c1-9243-4f30-8840-13b03dd67254 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:39.843482 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-829386c1-9243-4f30-8840-13b03dd67254 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:39.844089 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-829386c1-9243-4f30-8840-13b03dd67254 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:39.844840 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-829386c1-9243-4f30-8840-13b03dd67254 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:39.845268 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-829386c1-9243-4f30-8840-13b03dd67254 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:39.924360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-829386c1-9243-4f30-8840-13b03dd67254 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091690 May 27 03:28:39.924957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 287/586] 10.222.0.62 () {60 vars in 1315 bytes} [Fri May 27 03:28:39 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:28:40.852091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-5c4199f7-500e-407e-8766-a92e7ee011e9 req-29e2d67d-82aa-456e-aa08-0ca0cbc59d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d97624-4fe0-488b-a0f3-99774e529c62", "tag": "31e8a7b7-f72a-49ad-a5a2-2f8d16acd296"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:40.860518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-5c4199f7-500e-407e-8766-a92e7ee011e9 req-29e2d67d-82aa-456e-aa08-0ca0cbc59d8a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:40.860959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-5c4199f7-500e-407e-8766-a92e7ee011e9 req-29e2d67d-82aa-456e-aa08-0ca0cbc59d8a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:40.871697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-5c4199f7-500e-407e-8766-a92e7ee011e9 req-29e2d67d-82aa-456e-aa08-0ca0cbc59d8a service nova] Creating event network-changed:31e8a7b7-f72a-49ad-a5a2-2f8d16acd296 for instance f7d97624-4fe0-488b-a0f3-99774e529c62 on hv-cinder-82880 May 27 03:28:40.876599 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-5c4199f7-500e-407e-8766-a92e7ee011e9 req-29e2d67d-82aa-456e-aa08-0ca0cbc59d8a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028119 May 27 03:28:40.877181 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 300/587] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:45.593155 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1067431129", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1096312396", "security_groups": [{"name": "tempest-secgroup-smoke-73264536"}], "block_device_mapping_v2": [{"uuid": "b31e1cc7-d675-4d5f-99ce-5c35c15bae96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "561895ec-13c2-4737-9f4c-a28189f41261"}]}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:45.701749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] validate_networks() for [('561895ec-13c2-4737-9f4c-a28189f41261', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:28:46.058969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:28:46.059389 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:28:46.059888 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:28:46.060297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:28:46.060706 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:28:46.070723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:46.071177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:46.072004 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:46.072444 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:46.089374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:46.093245 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for user 5c8ad338eb7b47c18dcb86f287e28858 and project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:46.149837 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:28:46.151942 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b31e1cc7-d675-4d5f-99ce-5c35c15bae96',volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:28:46.274603 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-cb275f83-cec4-48d1-9924-debc96cbf4ad tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.685730 May 27 03:28:46.275233 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 288/588] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:28:45 2022] POST /compute/v2.1/servers => generated 404 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:28:46.293014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-804889ed-0796-4ff8-ae85-9519fd3008fd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:46.293715 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-804889ed-0796-4ff8-ae85-9519fd3008fd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:46.296097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:46.352751 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-804889ed-0796-4ff8-ae85-9519fd3008fd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:46.359436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-804889ed-0796-4ff8-ae85-9519fd3008fd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1095 microversion: 2.1 time: 0.078075 May 27 03:28:46.360056 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 301/589] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:46 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:47.378731 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:47.379492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:47.383131 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:47.392243 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:47.393193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:47.394128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:47.394722 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:47.487136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:47.495112 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-579ca3e6-1424-4723-886e-e5bd9043890f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1211 microversion: 2.1 time: 0.122825 May 27 03:28:47.495661 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 289/590] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:47 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1211 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:48.512080 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:48.512697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:48.522295 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:48.522748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:48.523512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:48.523974 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:48.674609 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:48.682240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-53d2ad85-bd62-4b2e-8f61-229f11dc6797 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.174029 May 27 03:28:48.682816 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 302/591] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:48 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:48.818711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-bac416e7-940e-4b5f-a296-b5c3e376cd4d req-2950f2d3-9846-473d-9aa8-aa7236b7b257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b74f0adb-3455-49d5-9bae-908876fbd9a9", "tag": "7e5c7f67-26e9-494e-9521-c8fe58036825"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:48.833480 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-bac416e7-940e-4b5f-a296-b5c3e376cd4d req-2950f2d3-9846-473d-9aa8-aa7236b7b257 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:48.834017 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-bac416e7-940e-4b5f-a296-b5c3e376cd4d req-2950f2d3-9846-473d-9aa8-aa7236b7b257 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:48.846429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-bac416e7-940e-4b5f-a296-b5c3e376cd4d req-2950f2d3-9846-473d-9aa8-aa7236b7b257 service nova] Creating event network-changed:7e5c7f67-26e9-494e-9521-c8fe58036825 for instance b74f0adb-3455-49d5-9bae-908876fbd9a9 on hv-cinder-82880 May 27 03:28:48.852017 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-bac416e7-940e-4b5f-a296-b5c3e376cd4d req-2950f2d3-9846-473d-9aa8-aa7236b7b257 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040067 May 27 03:28:48.853247 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 290/592] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:49.699284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:49.699921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:49.706960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.707407 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.708185 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.708615 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.837775 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:49.846000 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bf9ba78d-2ef4-4499-952f-c45352260827 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.150487 May 27 03:28:49.846806 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 303/593] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:49 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:50.864004 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:50.864687 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:50.870870 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.871310 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.872081 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.872512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:51.001610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:51.009053 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9afd25a3-0090-4009-a061-d6cd14204a87 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.150335 May 27 03:28:51.009604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 291/594] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:50 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:51.932616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a4f6c2ad-f8b1-4c02-a078-9ee9341fbc4c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:51.933585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a4f6c2ad-f8b1-4c02-a078-9ee9341fbc4c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:51.940323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a4f6c2ad-f8b1-4c02-a078-9ee9341fbc4c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:51.940772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a4f6c2ad-f8b1-4c02-a078-9ee9341fbc4c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:51.941539 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a4f6c2ad-f8b1-4c02-a078-9ee9341fbc4c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:51.941971 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a4f6c2ad-f8b1-4c02-a078-9ee9341fbc4c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:51.971370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a4f6c2ad-f8b1-4c02-a078-9ee9341fbc4c tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042656 May 27 03:28:51.971947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 304/595] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:28:51 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:28:52.025975 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:52.026664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:52.030593 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:52.031089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:52.033934 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.034379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.035147 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.035577 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.038069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.038551 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.039350 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.039791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.064467 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:28:52.067285 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:52.148798 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8abb60b8-0b84-49dc-a47e-080a69074ef8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 204 len: 0 microversion: 2.1 time: 0.121994 May 27 03:28:52.149472 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 305/596] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:28:52 2022] DELETE /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:28:52.158592 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:52.159379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:52.165184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.165639 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.166403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.166836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.276218 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:52.283702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a33d87d5-6f0d-4546-a738-8d86376f63f1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.261977 May 27 03:28:52.284300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 292/597] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:52 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:52.353920 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:52.362188 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cac8432e-192b-427d-bd68-424c01eab4ba tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1673 microversion: 2.1 time: 0.207843 May 27 03:28:52.362746 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 306/598] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:52 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1673 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:53.302402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:53.302402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:53.310618 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.311062 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.311964 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.312896 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.331557 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:53.378866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:53.379449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:53.385894 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.386338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.387086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.387512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.444693 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:53.452143 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ee0bdf30-f0a6-4139-9828-22199765e483 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.155567 May 27 03:28:53.452710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 293/599] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:53 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:53.515021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:53.522420 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f0bbdb18-21d2-452a-856e-55bb9d5dd788 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1673 microversion: 2.1 time: 0.147907 May 27 03:28:53.522976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 307/600] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:53 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:54.469413 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:54.470009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:54.476998 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.477437 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.478185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.478609 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.540468 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:54.541077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:54.548229 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.548672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.549423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.549851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.689521 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:54.690496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:54.697568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-77cd02b3-150c-47e4-9915-884ef5dd80c4 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1673 microversion: 2.1 time: 0.160817 May 27 03:28:54.698075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 308/601] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:54 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:54.707541 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5b98628a-8629-4414-838a-3c0b518651ca tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.232673 May 27 03:28:54.708172 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 294/602] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:54 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:55.272973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-61272da8-0e73-453c-b33b-421b3a04f9e8 req-9fcb40b3-c5a1-484b-97a4-704c84587618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a8db13-6978-4562-918e-29f8ca94ef3f", "name": "network-vif-deleted", "tag": "5f209ba7-5949-4139-a03b-ee0ae3138cea"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:55.281172 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-61272da8-0e73-453c-b33b-421b3a04f9e8 req-9fcb40b3-c5a1-484b-97a4-704c84587618 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.281619 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-61272da8-0e73-453c-b33b-421b3a04f9e8 req-9fcb40b3-c5a1-484b-97a4-704c84587618 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.292479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-61272da8-0e73-453c-b33b-421b3a04f9e8 req-9fcb40b3-c5a1-484b-97a4-704c84587618 service nova] Creating event network-vif-deleted:5f209ba7-5949-4139-a03b-ee0ae3138cea for instance 15a8db13-6978-4562-918e-29f8ca94ef3f on hv-cinder-82880 May 27 03:28:55.298092 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-61272da8-0e73-453c-b33b-421b3a04f9e8 req-9fcb40b3-c5a1-484b-97a4-704c84587618 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028760 May 27 03:28:55.298674 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 309/603] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:55.714746 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:55.715294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:55.725402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.726200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.726979 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.727406 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.728133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:55.729062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:55.738003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.738774 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.739859 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.740346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.762180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.762559 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.762976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lazy-loading 'fault' on Instance uuid 15a8db13-6978-4562-918e-29f8ca94ef3f {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:55.805684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:55.817894 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9acf6d57-a192-4a31-9b2f-ee027d1b7e0b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 200 len: 1327 microversion: 2.1 time: 0.104824 May 27 03:28:55.828371 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 295/604] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:55 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:55.876371 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:55.883882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2f82db94-6460-4349-8181-43981716a5f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.162556 May 27 03:28:55.884679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 310/605] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:55 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:56.836069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:56.836778 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:56.838654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:56.839499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:56.846492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:56.846939 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:56.847729 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:56.848315 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:56.862981 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] HTTP exception thrown: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Request method failure captured: May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f HTTP/1.1 May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERcx2FBLYCbZdFjHvdTYVAJvtQzhZ-z9nO2Xx4WgeB_lSJRWPbgAJjie37OoOWlx-K7qvo4slwyfuo--u3mNe7X3Al4ESwWyGoZBgF6YaIMjeH0EUPASwhLBt5EzzdVmFrmBqqRGQfRjuFKkkxb9gqsqq3rC72Wv1HGi2IxIrCtS_o May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: b114bd896cc6469184097ef9300613da May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:28:56.864567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b114bd896cc6469184097ef9300613da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b114bd896cc6469184097ef9300613da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}] May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeTestJSON-2050876474 May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: b114bd896cc6469184097ef9300613da May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: b34132c9382a44cd97bc2c4e40c97eec May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:28:56.866130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '15a8db13-6978-4562-918e-29f8ca94ef3f'} May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:56.867101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:28:56.868642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:28:56.869909 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Returning 404 to user: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:56.869909 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-58b9a5ab-4d97-406f-b90a-f35486ccd60e tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 404 len: 111 microversion: 2.1 time: 0.033785 May 27 03:28:56.869909 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 296/606] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:56 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:28:56.874776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-41ee3c16-128a-473d-ba86-ce4d54273874 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '.version_select at 0x7f40c0ad7670>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:56.878053 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:56.894754 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-41ee3c16-128a-473d-ba86-ce4d54273874 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166543922" status: 202 len: 0 microversion: 2.1 time: 0.023712 May 27 03:28:56.895534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 311/607] 10.222.0.62 () {58 vars in 1217 bytes} [Fri May 27 03:28:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166543922 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:28:56.911098 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:56.911702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:56.922744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:56.923428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:56.924946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:56.925536 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:57.116645 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:57.124502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b7317137-6584-4ce3-9f19-12f007f0ec26 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.226109 May 27 03:28:57.125178 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 297/608] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:56 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:57.610989 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-665c396e-6ea1-4c8f-bf48-2b50be565546 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'create', calling method: .version_select at 0x7f40c0c178b0>, body: {"keypair": {"name": "tempest-keypair-468440501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0IW6Dos+38ln8Dcbz3+73yAwe+Cm73iQ/8f4cgMzjJ7JEWV8txjGG0HV2qW3/Ryd5c+D7BviFNxqlPkXWoTbGBqpHXBLXulfJmonFmQDsoeXKEuCQT7mzV01wPHhC5ZQ=="}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:57.625975 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-665c396e-6ea1-4c8f-bf48-2b50be565546 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for project b114bd896cc6469184097ef9300613da. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:57.629857 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-665c396e-6ea1-4c8f-bf48-2b50be565546 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for user b34132c9382a44cd97bc2c4e40c97eec and project b114bd896cc6469184097ef9300613da. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:57.651469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-665c396e-6ea1-4c8f-bf48-2b50be565546 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044424 May 27 03:28:57.652115 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 312/609] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:28:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:58.140664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:58.141268 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:58.147710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:58.148182 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:58.148930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:58.149356 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:58.561101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:58.570516 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c6a89a3a-2c51-4ff2-b923-6f4a369323f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.433739 May 27 03:28:58.580490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 298/610] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:58 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:58.912776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-cbe57c81-c7d9-4af9-9714-d875a4f2b7f7 req-f16efbda-87dc-45e7-a199-80063f5bdfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b74f0adb-3455-49d5-9bae-908876fbd9a9", "name": "network-vif-plugged", "status": "completed", "tag": "7e5c7f67-26e9-494e-9521-c8fe58036825"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:58.921989 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cbe57c81-c7d9-4af9-9714-d875a4f2b7f7 req-f16efbda-87dc-45e7-a199-80063f5bdfa0 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:58.923484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cbe57c81-c7d9-4af9-9714-d875a4f2b7f7 req-f16efbda-87dc-45e7-a199-80063f5bdfa0 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:58.935734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-cbe57c81-c7d9-4af9-9714-d875a4f2b7f7 req-f16efbda-87dc-45e7-a199-80063f5bdfa0 service nova] Creating event network-vif-plugged:7e5c7f67-26e9-494e-9521-c8fe58036825 for instance b74f0adb-3455-49d5-9bae-908876fbd9a9 on hv-cinder-82880 May 27 03:28:58.942401 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-cbe57c81-c7d9-4af9-9714-d875a4f2b7f7 req-f16efbda-87dc-45e7-a199-80063f5bdfa0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 May 27 03:28:58.943017 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 313/611] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:59.255141 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1074082009", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98ca3cf1-95fa-41da-b7a2-51930fd197f1"}], "security_groups": [{"name": "tempest-securitygroup--524205182"}], "key_name": "tempest-keypair-468440501", "user_data": "}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:59.354143 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] validate_networks() for [('98ca3cf1-95fa-41da-b7a2-51930fd197f1', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:28:59.588240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:59.588944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:59.595307 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.595868 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.596614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.597050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.717979 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:28:59.718470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:28:59.719016 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:28:59.719488 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:28:59.720013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:28:59.728952 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.729268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:59.729670 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.730466 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.730902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.737190 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-12b955b2-7f8c-42f9-be58-b45d158be94b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1265 microversion: 2.1 time: 0.153317 May 27 03:28:59.737745 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 314/612] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:59 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:59.748253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for project b114bd896cc6469184097ef9300613da. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:59.752741 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Getting quotas for user b34132c9382a44cd97bc2c4e40c97eec and project b114bd896cc6469184097ef9300613da. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:59.763517 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:28:59.765843 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:28:59.814714 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b3da2b43-6c4e-4808-8ab6-a384ce5541fe tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563698 May 27 03:28:59.815582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 299/613] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:28:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:28:59.826283 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-202050c6-d6a2-4978-a62f-acc6b86fd806 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:59.827078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-202050c6-d6a2-4978-a62f-acc6b86fd806 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:59.879579 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-202050c6-d6a2-4978-a62f-acc6b86fd806 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:59.886690 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-202050c6-d6a2-4978-a62f-acc6b86fd806 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1237 microversion: 2.1 time: 0.064319 May 27 03:28:59.887248 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 315/614] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:28:59 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:00.755092 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:00.755668 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:00.762828 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.763269 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.764048 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.764479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.892608 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:00.899999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8809cd3a-b323-4f61-8f04-02d41ca01965 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1452 microversion: 2.1 time: 0.148698 May 27 03:29:00.900565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 300/615] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:00 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:00.903436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:00.904075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:00.911101 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.911560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.912355 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.912794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.915254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:00.915876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:00.921950 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.922391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.923149 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.923575 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.985957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:00.994071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bc785eba-485c-4732-8c7f-ae9906ebe439 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1233 microversion: 2.1 time: 0.094273 May 27 03:29:00.995354 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 316/616] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:00 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1233 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:01.066089 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:01.074012 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b740a80b-3654-45ef-8b8f-7e45133d86e7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1452 microversion: 2.1 time: 0.162304 May 27 03:29:01.074594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 301/617] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:00 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:02.011840 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:02.012472 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:02.020009 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:02.020452 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:02.021207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:02.021638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:02.085546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:02.094166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-017af2be-3407-497c-ad14-38ca9af15232 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1295 microversion: 2.1 time: 0.086782 May 27 03:29:02.094737 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 317/618] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:02 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:03.111615 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:03.112277 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:03.119026 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.119471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.120324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.120697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.566570 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:03.574266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a21048bb-7e9a-4baa-9f30-9f60e0db9d31 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1362 microversion: 2.1 time: 0.467060 May 27 03:29:03.574833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 302/619] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:03 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:03.870423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-14d602b6-018c-48dc-a590-00d8099990a8 req-be5255ce-659d-4a5b-ab5b-2fb3f5e153fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b74f0adb-3455-49d5-9bae-908876fbd9a9", "tag": "7e5c7f67-26e9-494e-9521-c8fe58036825"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:03.879553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-14d602b6-018c-48dc-a590-00d8099990a8 req-be5255ce-659d-4a5b-ab5b-2fb3f5e153fc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.880100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-14d602b6-018c-48dc-a590-00d8099990a8 req-be5255ce-659d-4a5b-ab5b-2fb3f5e153fc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.891770 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-14d602b6-018c-48dc-a590-00d8099990a8 req-be5255ce-659d-4a5b-ab5b-2fb3f5e153fc service nova] Creating event network-changed:7e5c7f67-26e9-494e-9521-c8fe58036825 for instance b74f0adb-3455-49d5-9bae-908876fbd9a9 on hv-cinder-82880 May 27 03:29:03.897113 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-14d602b6-018c-48dc-a590-00d8099990a8 req-be5255ce-659d-4a5b-ab5b-2fb3f5e153fc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030354 May 27 03:29:03.898135 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 318/620] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:04.591490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:04.593388 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:04.601685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:04.602141 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:04.602919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:04.603357 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:04.954713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:04.962152 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-be6148e8-66c1-4777-acd9-2141afa96a2d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1362 microversion: 2.1 time: 0.374496 May 27 03:29:04.962711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 303/621] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:04 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:05.915665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-8bad1a64-569f-4da3-b70d-6621e9fda1b1 req-f1f4aef9-fdd2-4f94-a8b5-45e74442e83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31aba7f-3700-45f9-84a4-bef83da3d5b3", "tag": "dbce52b7-89f4-4a12-9b4f-52599cf57a61"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:05.925093 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-8bad1a64-569f-4da3-b70d-6621e9fda1b1 req-f1f4aef9-fdd2-4f94-a8b5-45e74442e83b service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.925535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-8bad1a64-569f-4da3-b70d-6621e9fda1b1 req-f1f4aef9-fdd2-4f94-a8b5-45e74442e83b service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:05.938512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-8bad1a64-569f-4da3-b70d-6621e9fda1b1 req-f1f4aef9-fdd2-4f94-a8b5-45e74442e83b service nova] Creating event network-changed:dbce52b7-89f4-4a12-9b4f-52599cf57a61 for instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 on hv-cinder-82880 May 27 03:29:05.943288 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-8bad1a64-569f-4da3-b70d-6621e9fda1b1 req-f1f4aef9-fdd2-4f94-a8b5-45e74442e83b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031639 May 27 03:29:05.944165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 319/622] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:05.979460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:05.980088 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:05.987118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.987560 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:05.988340 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.988776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:06.121145 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:06.128513 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-34961192-dce8-448a-a5be-7a93080b7835 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1362 microversion: 2.1 time: 0.152792 May 27 03:29:06.129064 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 304/623] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:05 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:07.146396 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:07.147017 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:07.153387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:07.153842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:07.154594 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:07.155027 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:07.282324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:07.289753 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bbee3b8c-af51-431c-b2ed-a27192c050d5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1362 microversion: 2.1 time: 0.148200 May 27 03:29:07.290311 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 320/624] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:07 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:08.306957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:08.307509 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:08.314710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.314876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.315614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.316081 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.446271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:08.454475 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5439aa79-2e76-45d0-990e-992719024d96 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1362 microversion: 2.1 time: 0.151376 May 27 03:29:08.455040 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 305/625] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:08 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:09.070766 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-bcca00af-be75-41e7-9968-1e14fabb3894 req-80cafda6-e142-4a15-acfa-12f40f0b38e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31aba7f-3700-45f9-84a4-bef83da3d5b3", "name": "network-vif-plugged", "status": "completed", "tag": "dbce52b7-89f4-4a12-9b4f-52599cf57a61"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:09.080414 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-bcca00af-be75-41e7-9968-1e14fabb3894 req-80cafda6-e142-4a15-acfa-12f40f0b38e8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:09.080860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-bcca00af-be75-41e7-9968-1e14fabb3894 req-80cafda6-e142-4a15-acfa-12f40f0b38e8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:09.091951 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-bcca00af-be75-41e7-9968-1e14fabb3894 req-80cafda6-e142-4a15-acfa-12f40f0b38e8 service nova] Creating event network-vif-plugged:dbce52b7-89f4-4a12-9b4f-52599cf57a61 for instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 on hv-cinder-82880 May 27 03:29:09.096640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-bcca00af-be75-41e7-9968-1e14fabb3894 req-80cafda6-e142-4a15-acfa-12f40f0b38e8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029953 May 27 03:29:09.097227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 321/626] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:09.471639 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:09.472268 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:09.478730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:09.479175 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:09.479962 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:09.480426 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:09.607384 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:09.615322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-21af3667-24e5-476a-a1db-cc3a60f0af22 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1362 microversion: 2.1 time: 0.147493 May 27 03:29:09.615909 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 306/627] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:09 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:10.630005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=6 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:10.634831 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:10.635519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:10.642571 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:10.643010 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:10.643755 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:10.644210 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:10.777649 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:10.785335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-66eaf555-71a7-468d-8b9a-2b644458decf tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1362 microversion: 2.1 time: 0.156255 May 27 03:29:10.785892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 322/628] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:10 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:11.801798 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:11.802395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:11.804246 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:11.804882 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:11.811498 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.811975 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.812723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.813173 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.941182 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:11.948965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4e6cfc28-9f3e-49d2-96db-7a9d8e220354 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1548 microversion: 2.1 time: 0.151543 May 27 03:29:11.949469 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 307/629] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:11 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:11.965505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2f1112e9-b062-47af-87f8-e5f8f50112d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:11.965984 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2f1112e9-b062-47af-87f8-e5f8f50112d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:11.972394 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f1112e9-b062-47af-87f8-e5f8f50112d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.972839 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f1112e9-b062-47af-87f8-e5f8f50112d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.973591 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f1112e9-b062-47af-87f8-e5f8f50112d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.974025 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f1112e9-b062-47af-87f8-e5f8f50112d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.048928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2f1112e9-b062-47af-87f8-e5f8f50112d1 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087165 May 27 03:29:12.049527 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 323/630] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:29:11 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:13.210853 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-b95a345c-98be-4bee-8697-bf9f7b59245d req-971e3418-edd9-40cb-bb42-51c23f2e9258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31aba7f-3700-45f9-84a4-bef83da3d5b3", "tag": "dbce52b7-89f4-4a12-9b4f-52599cf57a61"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:13.219274 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-b95a345c-98be-4bee-8697-bf9f7b59245d req-971e3418-edd9-40cb-bb42-51c23f2e9258 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:13.219792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-b95a345c-98be-4bee-8697-bf9f7b59245d req-971e3418-edd9-40cb-bb42-51c23f2e9258 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:13.230597 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-b95a345c-98be-4bee-8697-bf9f7b59245d req-971e3418-edd9-40cb-bb42-51c23f2e9258 service nova] Creating event network-changed:dbce52b7-89f4-4a12-9b4f-52599cf57a61 for instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 on hv-cinder-82880 May 27 03:29:13.236171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-b95a345c-98be-4bee-8697-bf9f7b59245d req-971e3418-edd9-40cb-bb42-51c23f2e9258 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087106 May 27 03:29:13.236756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 308/631] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:14.589703 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:14.590218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:14.596111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.596553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.597297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.597730 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.675886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lazy-loading 'services' on Instance uuid bbe5601a-821f-42fb-8ad4-090c4640928d {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:14.744805 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6e9f8c39-f480-4e96-b1fb-8b27431a276f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments/f06df9d5-ad98-4fe5-a56e-a7c91186b1cf" status: 202 len: 0 microversion: 2.1 time: 0.159162 May 27 03:29:14.745385 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 324/632] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:29:14 2022] DELETE /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments/f06df9d5-ad98-4fe5-a56e-a7c91186b1cf => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:29:14.755321 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d4fdbe0e-9557-465f-8d36-d6b082fd0fa3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:14.756490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d4fdbe0e-9557-465f-8d36-d6b082fd0fa3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:14.762857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4fdbe0e-9557-465f-8d36-d6b082fd0fa3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.763375 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4fdbe0e-9557-465f-8d36-d6b082fd0fa3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.764241 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4fdbe0e-9557-465f-8d36-d6b082fd0fa3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.764776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d4fdbe0e-9557-465f-8d36-d6b082fd0fa3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.797261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d4fdbe0e-9557-465f-8d36-d6b082fd0fa3 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 May 27 03:29:14.797826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 309/633] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:29:14 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:15.809275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-86b3ff48-7afb-4cb5-8115-6ab679cddc2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.810274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-86b3ff48-7afb-4cb5-8115-6ab679cddc2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.817616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86b3ff48-7afb-4cb5-8115-6ab679cddc2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.818755 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86b3ff48-7afb-4cb5-8115-6ab679cddc2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.819551 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86b3ff48-7afb-4cb5-8115-6ab679cddc2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.820010 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-86b3ff48-7afb-4cb5-8115-6ab679cddc2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.848407 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-86b3ff48-7afb-4cb5-8115-6ab679cddc2c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043474 May 27 03:29:15.848958 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 325/634] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:29:15 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:29:15.919933 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.920461 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.926913 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.927290 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.928070 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.928501 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.955232 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:29:15.988104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:16.030053 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f323d78b-9c5d-42c5-ac0b-ad443b492722 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 204 len: 0 microversion: 2.1 time: 0.113583 May 27 03:29:16.030660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 310/635] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:29:15 2022] DELETE /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:16.039316 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:16.040139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:16.046270 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.046718 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:16.047476 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.047991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:16.174056 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:16.177798 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:16.182588 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-791e6fdf-a60d-460f-bfba-a846b12add5d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1690 microversion: 2.1 time: 0.147093 May 27 03:29:16.183158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 326/636] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:16 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:17.200365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:17.201030 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:17.207541 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:17.208030 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:17.208795 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:17.209227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:17.335651 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:17.343068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f237d5e2-cf76-4b09-a69f-5e439321fb8c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1690 microversion: 2.1 time: 0.147053 May 27 03:29:17.343632 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 311/637] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:17 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:18.359536 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:18.360183 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:18.363545 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:18.369839 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.370284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.371039 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.371470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.510462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:18.517896 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c32d6d09-ffe2-4338-8d65-dcfd819b0685 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1690 microversion: 2.1 time: 0.162253 May 27 03:29:18.518504 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 327/638] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:18 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:19.534855 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:19.535491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:19.537905 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:19.543225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.543673 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:19.544456 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.544891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:19.675920 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:19.683339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c64bd836-7f12-4195-af53-854391a2b724 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1690 microversion: 2.1 time: 0.152335 May 27 03:29:19.683926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 312/639] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:19 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:20.701063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.701774 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:20.710961 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.711412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.712328 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.712861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.940929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.949002 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5a6e84d3-d9c4-4a9d-a9f7-7fd622f1aa96 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 200 len: 1622 microversion: 2.1 time: 0.251738 May 27 03:29:20.949748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 328/640] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 1622 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:20.953439 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-2e087ca6-0b22-4416-a224-7f209110eb8a req-564493b5-9527-4644-94d6-87a184f46216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe5601a-821f-42fb-8ad4-090c4640928d", "name": "network-vif-deleted", "tag": "f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:20.962534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2e087ca6-0b22-4416-a224-7f209110eb8a req-564493b5-9527-4644-94d6-87a184f46216 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.963208 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2e087ca6-0b22-4416-a224-7f209110eb8a req-564493b5-9527-4644-94d6-87a184f46216 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.974426 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-2e087ca6-0b22-4416-a224-7f209110eb8a req-564493b5-9527-4644-94d6-87a184f46216 service nova] Creating event network-vif-deleted:f7d0c0e0-ead7-4c29-b7f2-9f1ac1be3ce2 for instance bbe5601a-821f-42fb-8ad4-090c4640928d on hv-cinder-82880 May 27 03:29:20.979459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-2e087ca6-0b22-4416-a224-7f209110eb8a req-564493b5-9527-4644-94d6-87a184f46216 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029532 May 27 03:29:20.983068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 313/641] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:29:21.966697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:21.967311 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: bbe5601a-821f-42fb-8ad4-090c4640928d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:21.974819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:21.975264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:21.976097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:21.976531 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:21.990793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] HTTP exception thrown: Instance bbe5601a-821f-42fb-8ad4-090c4640928d could not be found. May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Request method failure captured: May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d HTTP/1.1 May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERVtl-lSxtKnD-S3B2Xt4kgPJOU6kBuQN11Sb1FuqqwO7bW9rMo8vZlXCoft9Hft3VMLZjEDTzH86PwKcKGCJPa6ytczeEYBZPm36-d-4WdkLJghrsraT70FMuHLMbwzqklas-xxSkAGQKJLTz793uz5PUbIov7aDD6Sv2raCqF2GI May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:29:21.992496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}] May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: e8fddb1cf74d4135b41000f8a6293020 May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance bbe5601a-821f-42fb-8ad4-090c4640928d could not be found. May 27 03:29:21.994019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'bbe5601a-821f-42fb-8ad4-090c4640928d'} May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe5601a-821f-42fb-8ad4-090c4640928d could not be found. May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:21.998337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe5601a-821f-42fb-8ad4-090c4640928d could not be found. May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe5601a-821f-42fb-8ad4-090c4640928d could not be found. May 27 03:29:21.999624 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:22.000774 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Returning 404 to user: Instance bbe5601a-821f-42fb-8ad4-090c4640928d could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:22.000774 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8aaf64da-9068-47ab-b074-c9bb8207b6af tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d" status: 404 len: 111 microversion: 2.1 time: 0.031161 May 27 03:29:22.000774 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 329/642] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:21 2022] GET /compute/v2.1/servers/bbe5601a-821f-42fb-8ad4-090c4640928d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:22.005558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-259b60c6-f9ae-4df0-9c2a-366437f44ec1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '.version_select at 0x7f40c0361b80>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:22.024993 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-259b60c6-f9ae-4df0-9c2a-366437f44ec1 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741973910" status: 202 len: 0 microversion: 2.1 time: 0.025645 May 27 03:29:22.028819 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 314/643] 10.222.0.62 () {58 vars in 1220 bytes} [Fri May 27 03:29:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741973910 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:29:24.693543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-16556ff5-1531-49fd-9414-94628f5a7044 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:24.694017 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-16556ff5-1531-49fd-9414-94628f5a7044 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:24.700000 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16556ff5-1531-49fd-9414-94628f5a7044 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:24.700440 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16556ff5-1531-49fd-9414-94628f5a7044 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:24.701184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16556ff5-1531-49fd-9414-94628f5a7044 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:24.701612 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-16556ff5-1531-49fd-9414-94628f5a7044 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:24.724919 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-16556ff5-1531-49fd-9414-94628f5a7044 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/ips" status: 200 len: 151 microversion: 2.20 time: 0.083885 May 27 03:29:24.725483 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 330/644] 10.222.0.62 () {60 vars in 1288 bytes} [Fri May 27 03:29:24 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/ips => generated 151 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:29:25.088069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:25.088681 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:25.095850 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.096958 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:25.097714 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.098148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:25.121958 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:29:25.201592 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-555e2c51-bffc-4eba-bcdc-d788a4e19f5a tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "DELETE /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 204 len: 0 microversion: 2.1 time: 0.117162 May 27 03:29:25.202169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 315/645] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:29:25 2022] DELETE /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:25.210878 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:25.211490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:25.217631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.218078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:25.218834 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.219266 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:25.348983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:25.356428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2485f381-7ca8-4e1e-8419-c03c263f646d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1508 microversion: 2.1 time: 0.149437 May 27 03:29:25.356985 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 331/646] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:25 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:26.373917 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:26.374588 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:26.381070 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:26.381512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:26.382253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:26.382681 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:26.514540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:26.522441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-70f89c4c-b64e-421a-b8f8-69d1037ec84f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1508 microversion: 2.1 time: 0.152669 May 27 03:29:26.523005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 316/647] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:26 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:26.802343 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:26.802823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:26.809464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:26.809911 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:26.810659 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:26.811094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:26.835714 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lazy-loading 'flavor' on Instance uuid f7d97624-4fe0-488b-a0f3-99774e529c62 {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:27.092596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ccafa402-c49b-4a8b-b24e-4815596ae1d4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/action" status: 202 len: 0 microversion: 2.20 time: 0.294044 May 27 03:29:27.093202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 332/648] 10.222.0.62 () {62 vars in 1318 bytes} [Fri May 27 03:29:26 2022] POST /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:27.101170 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:27.101816 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:27.107773 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.108250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.108998 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.109462 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.235294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.243645 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.245171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.246316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bcd40900-47cf-45ed-a725-e23f70f9b8c3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.149045 May 27 03:29:27.246867 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 317/649] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:27 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:27.540218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:27.540917 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:27.547171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.547614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.548392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.548824 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.676657 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.684674 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8c679962-1b29-4cc8-8338-81782c76d287 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1508 microversion: 2.1 time: 0.148449 May 27 03:29:27.685245 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 333/650] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:27 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:28.265572 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:28.266416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:28.273726 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.274168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.274922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.275354 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.489633 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.497617 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.499112 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.500282 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8a6f9a76-8b3c-42c3-8f09-55bf491d8dc3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.238652 May 27 03:29:28.500834 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 318/651] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:28 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:28.698407 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-2b8f2531-0240-4579-9a66-701404ec5599 req-db70580b-ec0f-4ac4-87d8-b84595e74642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f", "name": "network-vif-deleted", "tag": "c41e6da8-005c-4d31-9ffa-09feba8629e5"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:28.702905 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:28.704218 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:28.706861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-2b8f2531-0240-4579-9a66-701404ec5599 req-db70580b-ec0f-4ac4-87d8-b84595e74642 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.707733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-2b8f2531-0240-4579-9a66-701404ec5599 req-db70580b-ec0f-4ac4-87d8-b84595e74642 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.713059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.713564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.714584 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.715086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.718922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-2b8f2531-0240-4579-9a66-701404ec5599 req-db70580b-ec0f-4ac4-87d8-b84595e74642 service nova] Creating event network-vif-deleted:c41e6da8-005c-4d31-9ffa-09feba8629e5 for instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f on hv-cinder-82880 May 27 03:29:28.723671 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-2b8f2531-0240-4579-9a66-701404ec5599 req-db70580b-ec0f-4ac4-87d8-b84595e74642 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029068 May 27 03:29:28.727366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 334/652] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:28.781993 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.792856 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-439bab2a-3d2b-4a2a-a7b4-5f684a317f12 tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 200 len: 1466 microversion: 2.1 time: 0.094168 May 27 03:29:28.793664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 319/653] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:28 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 1466 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:29.519631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:29.520278 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:29.526533 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.526977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.527723 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.528182 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.665183 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:29.673091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:29.674604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:29.675739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0df3d9a7-6175-42f6-91e3-e046ba986e6c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.161022 May 27 03:29:29.676318 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 335/654] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:29 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:29.810416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:29.810948 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:29.818936 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.819434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.820237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.820672 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.834772 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] HTTP exception thrown: Instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f could not be found. May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Request method failure captured: May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f HTTP/1.1 May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERVtl-lSxtKnD-S3B2Xt4kgPJOU6kBuQN11Sb1FuqqwO7bW9rMo8vZlXCoft9Hft3VMLZjEDTzH86PwKcKGCJPa6ytczeEYBZPm36-d-4WdkLJghrsraT70FMuHLMbwzqklas-xxSkAGQKJLTz793uz5PUbIov7aDD6Sv2raCqF2GI May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:29:29.836418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}] May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: e8fddb1cf74d4135b41000f8a6293020 May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f could not be found. May 27 03:29:29.837684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f'} May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f could not be found. May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:29.838508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f could not be found. May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f could not be found. May 27 03:29:29.839889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:29.841655 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Returning 404 to user: Instance 447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:29.841655 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5c75666d-bb68-467d-8275-8c007bf35d3c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f" status: 404 len: 111 microversion: 2.1 time: 0.031295 May 27 03:29:29.841655 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 320/655] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:29 2022] GET /compute/v2.1/servers/447e95d6-c030-4b8d-8cf2-e2bf3cf37f7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:29.846089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:29.846671 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:29.853045 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.853485 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.854243 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.854677 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.880141 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:29:29.956313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7acf4897-8655-41a2-b280-9773dd1b002c tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "DELETE /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 204 len: 0 microversion: 2.1 time: 0.112666 May 27 03:29:29.957078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 336/656] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:29:29 2022] DELETE /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:29.965152 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:29.965764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:29.971936 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.972385 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.973142 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.973579 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:30.103460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:30.110940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-75da672e-4b69-40de-a0ba-1d7696d406cc tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.149601 May 27 03:29:30.112026 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 321/657] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:29 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:30.694306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:30.695023 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:30.700983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:30.701425 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:30.702171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:30.702598 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:30.831378 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:30.839243 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:30.840753 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:30.841893 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7b6ffa53-eec7-42d4-ac77-74b78832ee5c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.152097 May 27 03:29:30.842561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 337/658] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:30 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:31.129144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:31.129755 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:31.136236 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.136682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.137434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.137868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.262030 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:31.269489 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-857659aa-8c82-4ec1-bd69-f24eb92b329f tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.144751 May 27 03:29:31.270045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 322/659] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:31 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:31.860284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:31.860888 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:31.867296 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.867734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.868517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.868944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.993828 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.002152 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.003662 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.004837 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fafc60ce-a7b0-442d-a636-ae8ff92b235d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.148408 May 27 03:29:32.005390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 338/660] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:31 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:32.285474 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:32.286091 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:32.292513 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:32.292950 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:32.293695 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:32.294118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:32.424444 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.431799 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-46516703-5f15-43cf-863f-12d253fa732d tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.150331 May 27 03:29:32.432376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 323/661] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:32 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:33.022421 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:33.023021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:33.029474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.029918 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.030667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.031093 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.162439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.170325 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.171812 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.172976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-df4557cb-8591-42bf-884c-61bda1d30670 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.154404 May 27 03:29:33.173528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 339/662] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:33 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:33.449361 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:33.450002 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:33.457311 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.457759 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.458579 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.459011 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.673566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8fddb1cf74d4135b41000f8a6293020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e539cb7b0fe47d6bdece2805d4ad0c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.681203 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-85a8112d-f8c0-45ba-b328-d8da08509cef tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 200 len: 1521 microversion: 2.1 time: 0.235617 May 27 03:29:33.681970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 324/663] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:33 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:33.844956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-145681f6-113c-434f-91f9-5abbd0e30491 req-3db9e826-4c7c-4580-96e8-7d9d704f61de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66633a35-54c4-43cf-9173-307af9be25ed", "name": "network-vif-deleted", "tag": "24e06267-7c42-4615-b99c-ea36432e8bbc"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:33.853832 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-145681f6-113c-434f-91f9-5abbd0e30491 req-3db9e826-4c7c-4580-96e8-7d9d704f61de service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.854293 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-145681f6-113c-434f-91f9-5abbd0e30491 req-3db9e826-4c7c-4580-96e8-7d9d704f61de service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.866487 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-145681f6-113c-434f-91f9-5abbd0e30491 req-3db9e826-4c7c-4580-96e8-7d9d704f61de service nova] Creating event network-vif-deleted:24e06267-7c42-4615-b99c-ea36432e8bbc for instance 66633a35-54c4-43cf-9173-307af9be25ed on hv-cinder-82880 May 27 03:29:33.871980 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-145681f6-113c-434f-91f9-5abbd0e30491 req-3db9e826-4c7c-4580-96e8-7d9d704f61de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030350 May 27 03:29:33.875319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 340/664] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:34.190567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:34.191254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:34.197681 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.198120 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.198878 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.199557 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.329112 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:34.338404 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:34.340057 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:34.342003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bbd8ee3c-188e-469d-9877-4fba031513fd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.155088 May 27 03:29:34.343020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 325/665] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:34 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:34.699550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:34.700268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] [instance: 66633a35-54c4-43cf-9173-307af9be25ed] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:34.706403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.706847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.707600 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.708074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.720991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] HTTP exception thrown: Instance 66633a35-54c4-43cf-9173-307af9be25ed could not be found. May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Request method failure captured: May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed HTTP/1.1 May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERVtl-lSxtKnD-S3B2Xt4kgPJOU6kBuQN11Sb1FuqqwO7bW9rMo8vZlXCoft9Hft3VMLZjEDTzH86PwKcKGCJPa6ytczeEYBZPm36-d-4WdkLJghrsraT70FMuHLMbwzqklas-xxSkAGQKJLTz793uz5PUbIov7aDD6Sv2raCqF2GI May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:29:34.722568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e539cb7b0fe47d6bdece2805d4ad0c1"}]}] May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 5e539cb7b0fe47d6bdece2805d4ad0c1 May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404404177 May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: e8fddb1cf74d4135b41000f8a6293020 May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404404177-project May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 66633a35-54c4-43cf-9173-307af9be25ed could not be found. May 27 03:29:34.724074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '66633a35-54c4-43cf-9173-307af9be25ed'} May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66633a35-54c4-43cf-9173-307af9be25ed could not be found. May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:34.724991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66633a35-54c4-43cf-9173-307af9be25ed could not be found. May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66633a35-54c4-43cf-9173-307af9be25ed could not be found. May 27 03:29:34.726486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:34.727947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] Returning 404 to user: Instance 66633a35-54c4-43cf-9173-307af9be25ed could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:34.727947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-13fdfdbc-184c-477d-82f6-47da7477ca5e tempest-ServerRescueNegativeTestJSON-1404404177 tempest-ServerRescueNegativeTestJSON-1404404177-project] 10.222.0.62 "GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed" status: 404 len: 111 microversion: 2.1 time: 0.029014 May 27 03:29:34.727947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 341/666] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:34 2022] GET /compute/v2.1/servers/66633a35-54c4-43cf-9173-307af9be25ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:35.361268 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:35.361977 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:35.368476 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:35.368915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:35.369686 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:35.370111 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:35.597967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:35.605762 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:35.607255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:35.608422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a23a5fcd-b1a1-4efc-9861-ae6ed3bf2ed2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.251097 May 27 03:29:35.608971 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 326/667] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:35 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:36.626547 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:36.627236 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:36.634126 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.634654 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.635486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.636014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.775264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.789553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:36.793655 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.795392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.797106 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-954cff93-35c2-4949-80db-bffc3f9959eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.174486 May 27 03:29:36.803872 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 342/668] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:36 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:37.816020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:37.816626 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:37.829634 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:37.830347 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:37.831432 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:37.832040 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:37.854649 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:38.099672 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:38.109162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:38.112054 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:38.114392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-736615c2-be20-4fb7-9777-b73201b9024a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.302881 May 27 03:29:38.115408 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 327/669] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:37 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:39.132888 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:39.133490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:39.141287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:39.141731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:39.142589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:39.143022 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:39.280323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:39.288533 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:39.290034 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:39.291186 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a2f2d8ae-2cfc-4575-b640-12bff842381d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.162297 May 27 03:29:39.291732 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 343/670] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:39 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:39.321561 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a126450b-70c3-4f89-8708-1c7379d9a14a tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Action: 'create', calling method: .version_select at 0x7f40c035df70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1850633109", "metadata": {"Type": "work"}}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a126450b-70c3-4f89-8708-1c7379d9a14a tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Request method failure captured: May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 122 May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEWjB4xTet0RC6EUuUUEsAGf0uTfXI9Dn7dxW7z4LgsX0wD1vv3Pa2X-lUA2h8wGT3RzolGiGL2PDycGhKOwYaY24O6VEiZE39SXNtg3mVX1rkhv-FFaQEXEtMiaW89r2MPdJEb_CI2dlueD_GC7ciqpLZyT89KC73LoOFo3DdFutZI May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:29:39.327132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}] May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 2999115bc4fc4a8fbac238d94b58f4d6 May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1850633109", "metadata": {"Type": "work"}}} May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: May 27 03:29:39.328900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1850633109', 'metadata': {'Type': 'work'}}}} May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise error May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi '#$%' May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:39.329787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:29:39.331271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:29:39.332499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:29:39.332499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.332499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a126450b-70c3-4f89-8708-1c7379d9a14a tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:39.332499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a126450b-70c3-4f89-8708-1c7379d9a14a tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122772 May 27 03:29:39.332499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 328/671] 10.222.0.62 () {60 vars in 1155 bytes} [Fri May 27 03:29:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:29:39.338279 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ac05d794-e8fd-47fb-a26e-cee1d4dede8b tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Action: 'create', calling method: .version_select at 0x7f40c0b78280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1800302829", "metadata": {"Type": "work"}}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ac05d794-e8fd-47fb-a26e-cee1d4dede8b tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Request method failure captured: May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 120 May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEWjB4xTet0RC6EUuUUEsAGf0uTfXI9Dn7dxW7z4LgsX0wD1vv3Pa2X-lUA2h8wGT3RzolGiGL2PDycGhKOwYaY24O6VEiZE39SXNtg3mVX1rkhv-FFaQEXEtMiaW89r2MPdJEb_CI2dlueD_GC7ciqpLZyT89KC73LoOFo3DdFutZI May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:29:39.341577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}] May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 2999115bc4fc4a8fbac238d94b58f4d6 May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1800302829", "metadata": {"Type": "work"}}} May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: May 27 03:29:39.343095 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1800302829', 'metadata': {'Type': 'work'}}}} May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise error May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi '0' May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:39.344066 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:29:39.345738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:29:39.347098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:29:39.347098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.347098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ac05d794-e8fd-47fb-a26e-cee1d4dede8b tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:39.347098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ac05d794-e8fd-47fb-a26e-cee1d4dede8b tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008401 May 27 03:29:39.347098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 344/672] 10.222.0.62 () {60 vars in 1155 bytes} [Fri May 27 03:29:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:29:39.352400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9bfce3f3-8ddd-438d-a8e9-fdbfb367994c tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Action: 'create', calling method: .version_select at 0x7f40c031e160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-580673045", "metadata": {"Type": "work"}}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9bfce3f3-8ddd-438d-a8e9-fdbfb367994c tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Request method failure captured: May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 118 May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEWjB4xTet0RC6EUuUUEsAGf0uTfXI9Dn7dxW7z4LgsX0wD1vv3Pa2X-lUA2h8wGT3RzolGiGL2PDycGhKOwYaY24O6VEiZE39SXNtg3mVX1rkhv-FFaQEXEtMiaW89r2MPdJEb_CI2dlueD_GC7ciqpLZyT89KC73LoOFo3DdFutZI May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:29:39.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}] May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 2999115bc4fc4a8fbac238d94b58f4d6 May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-580673045", "metadata": {"Type": "work"}}} May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: May 27 03:29:39.356255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-580673045', 'metadata': {'Type': 'work'}}}} May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise error May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi '' May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:39.357195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:29:39.358756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:29:39.359984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:29:39.359984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.359984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9bfce3f3-8ddd-438d-a8e9-fdbfb367994c tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:39.359984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9bfce3f3-8ddd-438d-a8e9-fdbfb367994c tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007330 May 27 03:29:39.359984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 329/673] 10.222.0.62 () {60 vars in 1155 bytes} [Fri May 27 03:29:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:29:39.364979 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-427f6475-53a4-4024-9f8e-fec6efb1b833 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Calling method '.version_select at 0x7f40c0bcef70>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:39.392312 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-427f6475-53a4-4024-9f8e-fec6efb1b833 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] HTTP exception thrown: Volume tempest-invalid-152113639 could not be found. May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-427f6475-53a4-4024-9f8e-fec6efb1b833 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Request method failure captured: May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-152113639 HTTP/1.1 May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEWjB4xTet0RC6EUuUUEsAGf0uTfXI9Dn7dxW7z4LgsX0wD1vv3Pa2X-lUA2h8wGT3RzolGiGL2PDycGhKOwYaY24O6VEiZE39SXNtg3mVX1rkhv-FFaQEXEtMiaW89r2MPdJEb_CI2dlueD_GC7ciqpLZyT89KC73LoOFo3DdFutZI May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:29:39.395331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}] May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 2999115bc4fc4a8fbac238d94b58f4d6 May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Volume tempest-invalid-152113639 could not be found. May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'tempest-invalid-152113639'} May 27 03:29:39.396851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-152113639 could not be found. (HTTP 404) (Request-ID: req-964a7ae8-327e-4416-aaee-c1e81ba5a84a) May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.397808 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:29:39.399170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-152113639 could not be found. May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:39.400528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-152113639 could not be found. May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-152113639 could not be found. May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-427f6475-53a4-4024-9f8e-fec6efb1b833 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Returning 404 to user: Volume tempest-invalid-152113639 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-427f6475-53a4-4024-9f8e-fec6efb1b833 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-152113639" status: 404 len: 98 microversion: 2.1 time: 0.035290 May 27 03:29:39.402150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 345/674] 10.222.0.62 () {58 vars in 1214 bytes} [Fri May 27 03:29:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-152113639 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 03:29:39.407525 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b5c46dff-d1b7-4b19-aa02-7e47e00efb25 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003659 May 27 03:29:39.408059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 330/675] 10.222.0.62 () {58 vars in 1139 bytes} [Fri May 27 03:29:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:29:39.416205 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-59cb5a49-aaac-4f9a-9cde-fd06667cb6ce tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003562 May 27 03:29:39.416697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 346/676] 10.222.0.62 () {58 vars in 1136 bytes} [Fri May 27 03:29:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:29:39.424848 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8a2b6a14-f2b7-4cc0-81a7-9205557a5774 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Calling method '.version_select at 0x7f40c035df70>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:39.452859 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-8a2b6a14-f2b7-4cc0-81a7-9205557a5774 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] HTTP exception thrown: Volume 9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c could not be found. May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8a2b6a14-f2b7-4cc0-81a7-9205557a5774 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Request method failure captured: May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/os-volumes/9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c HTTP/1.1 May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEWjB4xTet0RC6EUuUUEsAGf0uTfXI9Dn7dxW7z4LgsX0wD1vv3Pa2X-lUA2h8wGT3RzolGiGL2PDycGhKOwYaY24O6VEiZE39SXNtg3mVX1rkhv-FFaQEXEtMiaW89r2MPdJEb_CI2dlueD_GC7ciqpLZyT89KC73LoOFo3DdFutZI May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:29:39.454771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}] May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 2999115bc4fc4a8fbac238d94b58f4d6 May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Volume 9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c could not be found. May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c'} May 27 03:29:39.456296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c could not be found. (HTTP 404) (Request-ID: req-bb6cad39-e720-4de0-b8b4-42218c433cbd) May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.457455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:29:39.458775 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c could not be found. May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:29:39.460114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c could not be found. May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c could not be found. May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8a2b6a14-f2b7-4cc0-81a7-9205557a5774 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Returning 404 to user: Volume 9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8a2b6a14-f2b7-4cc0-81a7-9205557a5774 tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c" status: 404 len: 109 microversion: 2.1 time: 0.035088 May 27 03:29:39.461841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 331/677] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:29:39 2022] DELETE /compute/v2.1/os-volumes/9ad71a62-28e5-4d4a-89e9-22de3d3f7e2c => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:39.467050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f7003ef6-fb4e-4254-b7c8-33fcf63d2dda tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Calling method '.version_select at 0x7f40c0a9d280>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:39.495660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-f7003ef6-fb4e-4254-b7c8-33fcf63d2dda tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] HTTP exception thrown: Volume ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 could not be found. May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f7003ef6-fb4e-4254-b7c8-33fcf63d2dda tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Request method failure captured: May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/os-volumes/ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 HTTP/1.1 May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEWjB4xTet0RC6EUuUUEsAGf0uTfXI9Dn7dxW7z4LgsX0wD1vv3Pa2X-lUA2h8wGT3RzolGiGL2PDycGhKOwYaY24O6VEiZE39SXNtg3mVX1rkhv-FFaQEXEtMiaW89r2MPdJEb_CI2dlueD_GC7ciqpLZyT89KC73LoOFo3DdFutZI May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:29:39.497661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9893ffa59dc401cb2f6b953edfd6c15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9893ffa59dc401cb2f6b953edfd6c15"}]}] May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: e9893ffa59dc401cb2f6b953edfd6c15 May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-VolumesNegativeTest-2041907287 May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 2999115bc4fc4a8fbac238d94b58f4d6 May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-VolumesNegativeTest-2041907287-project May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Volume ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 could not be found. May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'ca2d98c6-75a9-4e73-97ac-2b3284f6ce42'} May 27 03:29:39.499158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 could not be found. (HTTP 404) (Request-ID: req-300ec413-c0cc-492a-b399-8c6e34409ea6) May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.500171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:29:39.501665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 could not be found. May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:29:39.503057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 could not be found. May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 could not be found. May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f7003ef6-fb4e-4254-b7c8-33fcf63d2dda tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] Returning 404 to user: Volume ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f7003ef6-fb4e-4254-b7c8-33fcf63d2dda tempest-VolumesNegativeTest-2041907287 tempest-VolumesNegativeTest-2041907287-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ca2d98c6-75a9-4e73-97ac-2b3284f6ce42" status: 404 len: 109 microversion: 2.1 time: 0.035799 May 27 03:29:39.504445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 347/678] 10.222.0.62 () {58 vars in 1244 bytes} [Fri May 27 03:29:39 2022] GET /compute/v2.1/os-volumes/ca2d98c6-75a9-4e73-97ac-2b3284f6ce42 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:40.309165 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:40.309755 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:40.316827 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:40.317582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:40.318301 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:40.318755 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:40.456219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:40.464519 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:40.466007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:40.467155 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-97855fe5-0bae-4411-9dfc-4104e06437b4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.162260 May 27 03:29:40.467705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 332/679] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:40 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:41.485720 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:41.486338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:41.492773 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:41.493229 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:41.493997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:41.494437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:41.632988 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:41.640954 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:41.642442 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:41.644158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-61818483-1950-4d7b-92f2-c7a4ed7c3054 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.163449 May 27 03:29:41.644705 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 348/680] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:41 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:42.662185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:42.662789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:42.669439 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:42.669885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:42.670630 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:42.671059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:42.802116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:42.810617 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:42.812245 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:42.813432 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-cb4c22a7-261d-445a-ada3-a25e91558416 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.155116 May 27 03:29:42.814083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 333/681] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:42 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:43.578917 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:43.579437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:43.586685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:43.587126 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:43.587890 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:43.588318 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:43.610475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lazy-loading 'flavor' on Instance uuid c46fbddd-5f15-41b9-aaab-7fe260aa7bcd {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:43.680978 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-93a0bf5c-359b-43f3-a9de-be589d18c3b0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "POST /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.105947 May 27 03:29:43.681541 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 349/682] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:29:43 2022] POST /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:29:43.690274 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:43.690921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:43.697745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:43.698552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:43.699834 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:43.700465 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:43.833174 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:43.834776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:43.835462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:43.840927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-042a1cfe-088e-4980-9376-693ade260675 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.155055 May 27 03:29:43.841496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 334/683] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:43 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:43.841679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:43.842125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:43.842885 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:43.843366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:43.976378 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:43.984484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:43.985961 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:43.987659 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f96ed8fb-d55b-4213-a52b-d2e7e2ca4b51 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1743 microversion: 2.20 time: 0.157066 May 27 03:29:43.988229 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 350/684] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:43 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:44.858392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:44.858996 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:44.865609 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:44.866054 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:44.866806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:44.867243 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:45.005874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:45.006561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:45.013030 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:45.013560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:45.014378 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:45.014873 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:45.020128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:45.027639 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5f07b6fd-f656-4e4e-b2a5-ff0fe40da06e tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.173121 May 27 03:29:45.028245 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 335/685] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:44 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:45.139420 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:45.147953 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:45.149464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:45.150619 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bbce4596-3652-4432-bdda-929b68350f55 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1743 microversion: 2.20 time: 0.148700 May 27 03:29:45.151169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 351/686] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:45 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:46.045239 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:46.045852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:46.052872 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:46.053319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:46.054075 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:46.054511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:46.169339 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:46.169956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:46.176960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:46.177404 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:46.178156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:46.178590 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:46.186428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:46.194921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-facf3c52-316a-46dc-9d40-1bd4132e7eab tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.153492 May 27 03:29:46.195467 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 336/687] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:46 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:46.306895 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:46.314669 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:46.316190 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:46.317569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0a8e4eaf-45b9-457c-a921-c4a6c2c8b4fc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1743 microversion: 2.20 time: 0.152122 May 27 03:29:46.318259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 352/688] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:46 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:47.211969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:47.212639 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:47.218957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:47.219412 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:47.220201 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:47.220636 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:47.336096 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:47.336711 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:47.343138 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:47.343589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:47.344385 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:47.344823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:47.350360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:47.357847 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d1fa61ad-a4fb-42f8-9aa2-294b67aa959a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.149853 May 27 03:29:47.358413 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 337/689] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:47 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:47.479990 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:47.487929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:47.489519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:47.490697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9f143a62-e08f-4690-a5b2-83c288af4e7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1743 microversion: 2.20 time: 0.158570 May 27 03:29:47.491246 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 353/690] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:47 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:48.374601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:48.375363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:48.384024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:48.384024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:48.384024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:48.384024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:48.509797 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:48.510408 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:48.519092 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:48.520754 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:48.521274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:48.522213 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:48.524109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:48.550787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:48.559483 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-43a1e1f1-cd63-407b-9a63-db82bb43d3a8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.188743 May 27 03:29:48.560854 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 338/691] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:48 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:48.683340 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:48.701886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:48.703630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:48.705155 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a65b4653-dbef-4d0c-9bb5-2f473144b5e2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.199964 May 27 03:29:48.706384 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 354/692] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:48 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:49.223155 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-82316d87-1623-4433-a378-7e4be530ae2f req-83e41120-ca4f-407c-b74b-752178573a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d97624-4fe0-488b-a0f3-99774e529c62", "name": "network-vif-plugged", "status": "completed", "tag": "31e8a7b7-f72a-49ad-a5a2-2f8d16acd296"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:49.232433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-82316d87-1623-4433-a378-7e4be530ae2f req-83e41120-ca4f-407c-b74b-752178573a68 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:49.232998 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-82316d87-1623-4433-a378-7e4be530ae2f req-83e41120-ca4f-407c-b74b-752178573a68 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:49.244344 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-82316d87-1623-4433-a378-7e4be530ae2f req-83e41120-ca4f-407c-b74b-752178573a68 service nova] Creating event network-vif-plugged:31e8a7b7-f72a-49ad-a5a2-2f8d16acd296 for instance f7d97624-4fe0-488b-a0f3-99774e529c62 on hv-cinder-82880 May 27 03:29:49.249593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-82316d87-1623-4433-a378-7e4be530ae2f req-83e41120-ca4f-407c-b74b-752178573a68 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185676 May 27 03:29:49.250484 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 339/693] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:49.577959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:49.579304 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:49.587011 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:49.587454 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:49.588233 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:49.588821 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:49.724207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:49.725603 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:49.729327 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:49.734776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:49.737312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:49.737630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-77c83fd5-eabb-4590-8ae0-cd61f3e835c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.163495 May 27 03:29:49.738200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 355/694] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:49 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:49.747776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:49.749403 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:49.750074 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:49.895596 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:49.905374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:49.906878 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:49.908080 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f78be271-da31-4cdd-a6c2-eba3d2a7d759 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.189026 May 27 03:29:49.919105 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 340/695] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:49 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:50.754712 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:50.755306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:50.761922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:50.762567 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:50.763773 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:50.764268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:50.931420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:50.932604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:50.939140 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:50.940682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:50.941104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:50.942311 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:50.942734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:50.947755 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3caf827f-9a9d-4e37-b04e-b992c43d1f54 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.197134 May 27 03:29:50.957538 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 356/696] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:50 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:51.128815 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:51.138854 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:51.140591 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:51.141887 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7da72eb1-6be0-4bce-84aa-6b5aef16cd9a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.215928 May 27 03:29:51.151866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 341/697] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:50 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:51.966259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:51.967240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:51.974726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:51.975842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:51.977216 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:51.978273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:52.147736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:52.162295 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:52.163657 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:52.169348 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-caa9405d-eaa4-43d2-89f7-c4be8093f615 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.207716 May 27 03:29:52.183756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:52.184658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 357/698] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:51 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:52.185042 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:52.186014 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:52.187067 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:52.389631 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:52.401244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:52.403025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:52.404425 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7b2546d5-12c6-4fb9-af83-65e46100f642 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.247415 May 27 03:29:52.407873 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 342/699] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:52 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:53.192870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:53.193398 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:53.202580 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.203022 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.203791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.206092 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.430683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:53.432137 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:53.438717 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.439424 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.440575 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.441195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.447680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:53.456734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f036e002-cf80-4764-a40c-04e68c7fba67 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.268169 May 27 03:29:53.457892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 358/700] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:53 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:53.604906 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:53.632962 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:53.635086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:53.636382 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8dc33ecc-a41a-4408-9eab-ffbc0ebd9169 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.214089 May 27 03:29:53.637490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 343/701] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:53 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:54.474295 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:54.474905 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:54.481821 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.482640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.483602 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.484409 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.640782 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:54.654327 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a3667922-6e64-42e1-93b8-f46a65ccc607 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.181430 May 27 03:29:54.655165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 359/702] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:54 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:54.662643 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:54.668730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:54.678564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.679242 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.680217 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.680801 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.845574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:54.856802 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:54.858512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:54.865227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-09679252-201b-4056-bf38-7dbf5fcd8014 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.211241 May 27 03:29:54.866071 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 344/703] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:54 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:55.671942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:55.672570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:55.681252 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:55.681705 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:55.684127 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:55.684577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:55.864469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:55.874575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-af40e8a5-fcbf-4285-a465-1649a77968d1 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.206414 May 27 03:29:55.877973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 360/704] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:55 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:55.891240 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:55.891872 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:55.898634 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:55.899310 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:55.900294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:55.900895 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:56.104822 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:56.117256 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:56.119579 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:56.121126 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-46fc5e1c-cea8-4a81-9a00-999b511a866a tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.241502 May 27 03:29:56.132580 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 345/705] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:55 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:56.894608 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:56.897047 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:56.906767 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:56.908712 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:56.910347 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:56.911108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.172354 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:57.173191 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-389a9cff-92b3-48c3-b287-41c55135cbe2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:57.174632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-389a9cff-92b3-48c3-b287-41c55135cbe2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:57.181489 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-389a9cff-92b3-48c3-b287-41c55135cbe2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.182151 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-389a9cff-92b3-48c3-b287-41c55135cbe2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.183109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-389a9cff-92b3-48c3-b287-41c55135cbe2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.183716 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-389a9cff-92b3-48c3-b287-41c55135cbe2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.186522 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-799ad439-49eb-409c-a4bd-24ec864cb6c2 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.295841 May 27 03:29:57.187093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 346/706] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:56 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:57.204862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:57.206094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:57.208874 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:57.210388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-389a9cff-92b3-48c3-b287-41c55135cbe2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/ips" status: 200 len: 146 microversion: 2.1 time: 0.445380 May 27 03:29:57.210960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 361/707] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:29:56 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/ips => generated 146 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:29:57.221872 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.224077 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.225072 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.225628 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.419723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:57.434495 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:57.436826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:57.441841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-92c98aea-6fb1-499f-8089-3b3bf1b98394 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1738 microversion: 2.20 time: 0.248220 May 27 03:29:57.445848 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 347/708] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:57 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:58.204731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:58.206074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:58.213866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.214314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.215082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.215512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.365656 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:58.375638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-01af6faf-9ed6-429d-8ced-6588276169aa tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.174845 May 27 03:29:58.376318 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 362/709] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:58 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:58.467251 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:58.467899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:58.478118 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.479250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.480527 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.481156 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.656911 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:58.663104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:58.667214 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:58.668942 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:58.670599 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f5e7267e-abf0-4ca8-a707-592e3a9263fa tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1720 microversion: 2.20 time: 0.210019 May 27 03:29:58.683139 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 348/710] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:58 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:58.692629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6278c9c8-20ed-49cc-be1c-2117bfc8d493 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49ea5b9-f37e-4aea-96b0-5faf77073928"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:58.693851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6278c9c8-20ed-49cc-be1c-2117bfc8d493 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:58.700384 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6278c9c8-20ed-49cc-be1c-2117bfc8d493 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.701042 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6278c9c8-20ed-49cc-be1c-2117bfc8d493 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.701801 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6278c9c8-20ed-49cc-be1c-2117bfc8d493 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.702410 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6278c9c8-20ed-49cc-be1c-2117bfc8d493 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:59.052478 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6278c9c8-20ed-49cc-be1c-2117bfc8d493 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364292 May 27 03:29:59.056497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 363/711] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:29:58 2022] POST /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:59.394710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:59.395343 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:59.401649 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:59.402093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:59.402838 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:59.403266 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:59.675281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:59.683967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-60a9223d-3e48-4a57-96b6-59a2752d03dd tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.293540 May 27 03:29:59.684804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 349/712] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:29:59 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:59.700570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:59.701972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:59.709528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:59.709976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:59.710940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:59.711381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:59.847342 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:59.855289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:59.856802 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:59.857947 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-92d0233f-7fd3-4594-98c2-e07df516828b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1720 microversion: 2.20 time: 0.162241 May 27 03:29:59.858488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 364/713] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:29:59 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:00.702350 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:00.703111 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:00.709328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:00.709882 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:00.710703 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:00.711175 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:00.848384 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:00.855917 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-033f4343-8d6f-458f-8717-0090911e154a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.157903 May 27 03:30:00.856480 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 350/714] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:00 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:00.875506 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:00.876153 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:00.882588 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:00.883021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:00.883768 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:00.884257 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:01.013418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:01.021776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:01.023269 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:01.024447 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-043fc6a7-695f-4ccc-a0d0-3a1b3a295dbd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1720 microversion: 2.20 time: 0.152810 May 27 03:30:01.024998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 365/715] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:00 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:01.872643 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:01.873246 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:01.880664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:01.881110 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:01.881859 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:01.882287 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:02.023065 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:02.031395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fee882e4-2438-451f-ac49-3c0f5337ae01 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.162397 May 27 03:30:02.032149 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 351/716] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:01 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:02.043856 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:02.044527 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:02.051659 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:02.052132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:02.052900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:02.053330 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:02.188870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:02.196970 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:02.198455 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:02.199598 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a892f835-0e04-4cd3-827e-081b2cdb7491 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1723 microversion: 2.20 time: 0.160044 May 27 03:30:02.200185 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 366/717] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:02 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:02.217073 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b7781357-794f-4db4-85e1-fd48395d9c77 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3842052-69a0-4ece-afc6-f957834fcaad"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:02.218240 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b7781357-794f-4db4-85e1-fd48395d9c77 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:02.225760 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7781357-794f-4db4-85e1-fd48395d9c77 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:02.226380 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7781357-794f-4db4-85e1-fd48395d9c77 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:02.228137 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7781357-794f-4db4-85e1-fd48395d9c77 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:02.228741 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b7781357-794f-4db4-85e1-fd48395d9c77 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:02.618428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b7781357-794f-4db4-85e1-fd48395d9c77 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.405291 May 27 03:30:02.623923 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 352/718] 10.222.0.62 () {62 vars in 1363 bytes} [Fri May 27 03:30:02 2022] POST /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-volume_attachments => generated 188 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:30:02.747627 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3c3ce5b5-ca40-4d06-b909-c0ca6daf0593 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:02.748145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3c3ce5b5-ca40-4d06-b909-c0ca6daf0593 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:02.755099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3c3ce5b5-ca40-4d06-b909-c0ca6daf0593 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:02.755545 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3c3ce5b5-ca40-4d06-b909-c0ca6daf0593 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:02.756432 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3c3ce5b5-ca40-4d06-b909-c0ca6daf0593 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:02.756766 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3c3ce5b5-ca40-4d06-b909-c0ca6daf0593 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.021592 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3c3ce5b5-ca40-4d06-b909-c0ca6daf0593 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-volume_attachments/d3842052-69a0-4ece-afc6-f957834fcaad" status: 202 len: 0 microversion: 2.20 time: 0.278136 May 27 03:30:03.022294 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 367/719] 10.222.0.62 () {60 vars in 1456 bytes} [Fri May 27 03:30:02 2022] DELETE /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-volume_attachments/d3842052-69a0-4ece-afc6-f957834fcaad => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:30:03.050602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.052329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.061381 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.062166 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.063516 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.064850 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.085685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-19fd8a64-cc26-4045-8ecc-e78e7daf6181 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:03.086276 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-19fd8a64-cc26-4045-8ecc-e78e7daf6181 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.096063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19fd8a64-cc26-4045-8ecc-e78e7daf6181 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.097099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19fd8a64-cc26-4045-8ecc-e78e7daf6181 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.098314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19fd8a64-cc26-4045-8ecc-e78e7daf6181 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.099161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-19fd8a64-cc26-4045-8ecc-e78e7daf6181 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.205361 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-19fd8a64-cc26-4045-8ecc-e78e7daf6181 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "POST /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/action" status: 202 len: 0 microversion: 2.20 time: 0.123573 May 27 03:30:03.207036 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 368/720] 10.222.0.62 () {62 vars in 1318 bytes} [Fri May 27 03:30:03 2022] POST /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:30:03.213949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-5e09a349-f168-4b85-826d-7f3fe042c57f req-394877e8-f22c-4840-a8ea-9da904bcf6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d97624-4fe0-488b-a0f3-99774e529c62", "name": "network-vif-unplugged", "status": "completed", "tag": "31e8a7b7-f72a-49ad-a5a2-2f8d16acd296"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:03.223738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-5e09a349-f168-4b85-826d-7f3fe042c57f req-394877e8-f22c-4840-a8ea-9da904bcf6c4 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.224480 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-5e09a349-f168-4b85-826d-7f3fe042c57f req-394877e8-f22c-4840-a8ea-9da904bcf6c4 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.234690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.244504 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.compute.server_external_events [req-5e09a349-f168-4b85-826d-7f3fe042c57f req-394877e8-f22c-4840-a8ea-9da904bcf6c4 service nova] Unable to find a host for instance f7d97624-4fe0-488b-a0f3-99774e529c62. Dropping event network-vif-unplugged {{(pid=117610) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 03:30:03.244733 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f033678b-9a52-4a04-a047-d58eef4d9950 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.198672 May 27 03:30:03.245439 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-5e09a349-f168-4b85-826d-7f3fe042c57f req-394877e8-f22c-4840-a8ea-9da904bcf6c4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037146 May 27 03:30:03.245720 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 353/721] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:03.248977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 369/722] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 03:30:03.259771 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.260529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.267611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.268094 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.268967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.269518 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.441269 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.449602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.451113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.452290 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9559b9c7-e5ff-4a93-a98e-cfa394b0a1eb tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1671 microversion: 2.20 time: 0.204730 May 27 03:30:03.452840 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 354/723] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:03.453929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5f69d502-8645-42cd-a2e9-7edefe470b1f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.455086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5f69d502-8645-42cd-a2e9-7edefe470b1f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.462593 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f69d502-8645-42cd-a2e9-7edefe470b1f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.463164 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f69d502-8645-42cd-a2e9-7edefe470b1f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.464085 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f69d502-8645-42cd-a2e9-7edefe470b1f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.464639 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5f69d502-8645-42cd-a2e9-7edefe470b1f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.497283 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5f69d502-8645-42cd-a2e9-7edefe470b1f tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048267 May 27 03:30:03.497845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 370/724] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:03.507918 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c6a189a4-2e3d-457b-81ff-9c968556b0b8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.508411 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c6a189a4-2e3d-457b-81ff-9c968556b0b8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.514485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a189a4-2e3d-457b-81ff-9c968556b0b8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.514925 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a189a4-2e3d-457b-81ff-9c968556b0b8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.515679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a189a4-2e3d-457b-81ff-9c968556b0b8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.516137 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c6a189a4-2e3d-457b-81ff-9c968556b0b8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.545708 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c6a189a4-2e3d-457b-81ff-9c968556b0b8 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/a49ea5b9-f37e-4aea-96b0-5faf77073928" status: 200 len: 194 microversion: 2.1 time: 0.041724 May 27 03:30:03.546297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 355/725] 10.222.0.62 () {58 vars in 1412 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/a49ea5b9-f37e-4aea-96b0-5faf77073928 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:04.263165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:04.264275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:04.274920 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.275926 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.277400 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.278024 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.439933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.448231 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9220ed6b-a859-4f03-8470-60bbaff9573a tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.189704 May 27 03:30:04.449206 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 371/726] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:04 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:04.470360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:04.471226 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:04.477741 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.478189 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.479136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.479573 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.668192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.677526 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.679812 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.681386 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-65ec6daa-0d26-4f58-b6cc-01764bba3bc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.214940 May 27 03:30:04.681966 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 356/727] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:04 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:04.934899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-1c7d4b25-1efb-44a5-a5c2-93fcbaa7936b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73388316-0592-403f-88ac-ad5a455ecbd5"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:04.935992 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-1c7d4b25-1efb-44a5-a5c2-93fcbaa7936b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:04.943288 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c7d4b25-1efb-44a5-a5c2-93fcbaa7936b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.943739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c7d4b25-1efb-44a5-a5c2-93fcbaa7936b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.944530 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c7d4b25-1efb-44a5-a5c2-93fcbaa7936b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.944966 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-1c7d4b25-1efb-44a5-a5c2-93fcbaa7936b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.270916 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-1c7d4b25-1efb-44a5-a5c2-93fcbaa7936b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "POST /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339772 May 27 03:30:05.271565 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 372/728] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:30:04 2022] POST /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:05.467308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:05.468441 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:05.482061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.482590 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.483061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.483796 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.620765 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.629151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d3c07094-9d2b-4fb3-b56f-a17e9a6faf26 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1508 microversion: 2.1 time: 0.165344 May 27 03:30:05.629726 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 357/729] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:05 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:05.647543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fe8d37b9-fa07-43d0-ad32-44ca1bac375c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:05.648316 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fe8d37b9-fa07-43d0-ad32-44ca1bac375c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:05.654481 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fe8d37b9-fa07-43d0-ad32-44ca1bac375c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.654929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fe8d37b9-fa07-43d0-ad32-44ca1bac375c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.655696 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fe8d37b9-fa07-43d0-ad32-44ca1bac375c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.656157 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fe8d37b9-fa07-43d0-ad32-44ca1bac375c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.660546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:05.701705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:05.702218 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:05.713020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.714414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.715335 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.715940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.770171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fe8d37b9-fa07-43d0-ad32-44ca1bac375c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "POST /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.128201 May 27 03:30:05.773117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 373/730] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:30:05 2022] POST /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:05.784005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:05.785271 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:05.798611 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.799367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.800932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.802131 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.885569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.899270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.901665 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.903752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-66782e2a-9452-48f2-b9b8-70da855e7fed tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.206393 May 27 03:30:05.904723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 358/731] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:05 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:05.967315 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.976314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-395b686b-5937-4d1b-bb23-6f2a573ab6d0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.200563 May 27 03:30:05.977331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 374/732] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:05 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:06.923291 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:06.924440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:06.938106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:06.940622 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:06.944457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:06.945096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:06.997082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:06.998188 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:07.011403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:07.014268 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:07.015196 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:07.018341 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:07.198169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:07.203702 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:07.208822 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6df2d384-5193-4c12-b359-afe574c8a013 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.218422 May 27 03:30:07.214009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:07.214778 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 375/733] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:06 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:07.216937 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:07.218493 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ef10fc46-a552-4dfe-9cf0-6ea3544d2c61 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.300702 May 27 03:30:07.219284 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 359/734] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:06 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:08.233307 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:08.234576 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:08.239115 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:08.239728 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:08.243755 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:08.244585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:08.245390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:08.245830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:08.252104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:08.252961 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:08.253992 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:08.254450 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:08.435910 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.450836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.453159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.455314 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5585db7e-bfd8-4509-82aa-1f503a0113cc tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.222561 May 27 03:30:08.465874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.466922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 360/735] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:08 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:08.480396 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ec0b2b39-71ff-4c93-ab49-dfb9992b0eff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.253119 May 27 03:30:08.481476 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 376/736] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:08 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:09.161569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-fd80218f-674e-4fb2-a322-f4584981c1fc req-d98448b6-bea6-40a4-86c3-03be279c641d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46fbddd-5f15-41b9-aaab-7fe260aa7bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "71e11d00-d642-48e1-acfd-a532d0199408"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:09.173243 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-fd80218f-674e-4fb2-a322-f4584981c1fc req-d98448b6-bea6-40a4-86c3-03be279c641d service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.173687 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-fd80218f-674e-4fb2-a322-f4584981c1fc req-d98448b6-bea6-40a4-86c3-03be279c641d service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.185665 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.compute.server_external_events [req-fd80218f-674e-4fb2-a322-f4584981c1fc req-d98448b6-bea6-40a4-86c3-03be279c641d service nova] Unable to find a host for instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd. Dropping event network-vif-unplugged {{(pid=117609) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 03:30:09.186547 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-fd80218f-674e-4fb2-a322-f4584981c1fc req-d98448b6-bea6-40a4-86c3-03be279c641d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028999 May 27 03:30:09.187428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 361/737] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 03:30:09.479927 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:09.482308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:09.489488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.490083 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.493364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.499627 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:09.501117 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:09.505505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.512262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.513860 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.515971 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.516982 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.740202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.741590 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.749229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-48d41e28-411f-453c-9c15-ba5147635c6f tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.252940 May 27 03:30:09.760180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 362/738] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:09 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:09.765436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.767312 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.769248 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-265564a0-6a93-423a-8f9b-0ac85f1ce01b tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.298964 May 27 03:30:09.769956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 377/739] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:09 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:10.767531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:10.768710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:10.777749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.778252 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.779519 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.780195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.791561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:10.793455 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:10.831100 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.831990 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.833038 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.833683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.862363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:11.061185 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.078085 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.079846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.081139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c1d3c403-0003-4758-9479-622afa442a13 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.295295 May 27 03:30:11.081709 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 378/740] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:10 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:11.097540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.106829 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6368015c-939b-477f-a968-e345803de2e0 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.343753 May 27 03:30:11.107406 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 363/741] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:10 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:12.100244 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:12.100970 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:12.107648 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.108130 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.108923 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.109359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.124623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:12.125336 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:12.132325 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.133034 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.133965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.134656 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.277295 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:12.289052 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:12.291368 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:12.292585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e417d05f-8e5e-4bd5-a7e6-9ec701659a45 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.196405 May 27 03:30:12.296272 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 379/742] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:12 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:12.305558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:12.314180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3e1e4bdd-01a2-4cd7-b0d6-12cc9dca1c63 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.193523 May 27 03:30:12.325569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 364/743] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:12 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:13.310553 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:13.311135 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:13.317847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:13.318291 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:13.319045 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:13.319469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:13.332324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:13.333636 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:13.341353 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:13.342229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:13.343221 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:13.355093 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:13.498671 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:13.509345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:13.511368 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:13.513178 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4e555dc8-85ab-40d7-95f7-6ccb40d05acd tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.206495 May 27 03:30:13.514892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 380/744] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:13 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:13.545170 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:13.556602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0afdd4c5-34e5-46ee-884d-36ea1f154927 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.228501 May 27 03:30:13.557351 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 365/745] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:13 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:14.532965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:14.533695 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:14.540663 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.541726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.542512 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.542944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.574270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:14.574974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:14.581965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.582838 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.583768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.584295 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.701009 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.709479 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.710987 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.712313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-fb825b03-19e0-4b6e-b715-fe7cc55af0a3 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.183286 May 27 03:30:14.712979 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 381/746] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:14 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:14.740955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.748708 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2a2419a0-2b2c-4582-b6c7-3224f49829f4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.178267 May 27 03:30:14.749408 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 366/747] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:14 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:15.732847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:15.733471 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:15.740143 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.740592 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:15.741355 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.741789 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:15.766434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:15.768906 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:15.776446 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.776899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:15.777657 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.778087 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:15.893692 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:15.903589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:15.905294 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:15.906666 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f8fdffdf-e294-4603-a218-0aa30a7bdf7c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.177731 May 27 03:30:15.907230 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 382/748] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:15 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:15.922440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:15.933373 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8160a2eb-61ab-4916-b806-f1e7795d5ecc tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1516 microversion: 2.1 time: 0.170866 May 27 03:30:15.934057 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 367/749] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:15 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:16.928810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:16.929412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:16.937034 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:16.937801 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:16.938226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:16.939150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:16.950265 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:16.950869 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:16.958142 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:16.958586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:16.959388 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:16.959827 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:17.077748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.086250 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.087736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.088912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c38a083f-b69c-43ff-84ac-fdefe533135d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.164183 May 27 03:30:17.089460 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 383/750] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:16 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:17.096041 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.104476 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-224cdb6a-1e6c-4f40-893b-f3f64bf05e70 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1518 microversion: 2.1 time: 0.157875 May 27 03:30:17.105049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 368/751] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:16 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:18.107410 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.108090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:18.115969 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.116525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.117449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.118006 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.122857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.123471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:18.133241 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.133688 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.134453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.134885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.257378 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:18.266519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:18.268569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:18.269981 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3dcea5ae-6a74-412e-8abc-ba2b5f0bb90d tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.166708 May 27 03:30:18.270769 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 384/752] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:18 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:18.286791 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:18.294957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6aad5380-41eb-465c-bbde-0ef76a779384 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.176126 May 27 03:30:18.295614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 369/753] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:18 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:18.322214 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bd9ec466-1de2-4f4f-916e-646e4188e696 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.323217 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bd9ec466-1de2-4f4f-916e-646e4188e696 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:18.329323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bd9ec466-1de2-4f4f-916e-646e4188e696 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.329770 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bd9ec466-1de2-4f4f-916e-646e4188e696 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.330742 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bd9ec466-1de2-4f4f-916e-646e4188e696 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.331232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bd9ec466-1de2-4f4f-916e-646e4188e696 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.361546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bd9ec466-1de2-4f4f-916e-646e4188e696 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043162 May 27 03:30:18.362016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 385/754] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:30:18 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:18.506169 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fd83efda-f9a7-479d-b040-21cc7d8f9d11 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.506660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fd83efda-f9a7-479d-b040-21cc7d8f9d11 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:18.512852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fd83efda-f9a7-479d-b040-21cc7d8f9d11 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.513196 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fd83efda-f9a7-479d-b040-21cc7d8f9d11 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.514173 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fd83efda-f9a7-479d-b040-21cc7d8f9d11 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.514730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fd83efda-f9a7-479d-b040-21cc7d8f9d11 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.704222 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fd83efda-f9a7-479d-b040-21cc7d8f9d11 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/a49ea5b9-f37e-4aea-96b0-5faf77073928" status: 200 len: 194 microversion: 2.1 time: 0.201920 May 27 03:30:18.704915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 370/755] 10.222.0.62 () {58 vars in 1412 bytes} [Fri May 27 03:30:18 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/a49ea5b9-f37e-4aea-96b0-5faf77073928 => generated 194 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:18.714371 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.714975 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:18.716956 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=68 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:18.723292 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.723739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.724543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.724977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.809372 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lazy-loading 'services' on Instance uuid e31aba7f-3700-45f9-84a4-bef83da3d5b3 {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:30:18.885760 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-38e5433b-a11d-4010-b6e3-427a51cba6e0 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/a49ea5b9-f37e-4aea-96b0-5faf77073928" status: 202 len: 0 microversion: 2.1 time: 0.174965 May 27 03:30:18.887957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 386/756] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:30:18 2022] DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/a49ea5b9-f37e-4aea-96b0-5faf77073928 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:19.288163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:19.288772 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:19.295262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.295713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.296507 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.296944 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.314662 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:19.316019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:19.323147 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.323690 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.324574 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.325072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.442892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:19.450865 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:19.452385 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:19.453550 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e0192390-73b7-4a64-aff5-ad3136cc23de tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.169264 May 27 03:30:19.454151 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 371/757] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:19 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:19.465914 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:19.473487 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-080567da-950e-4d21-9a0a-e128fc761fca tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.164020 May 27 03:30:19.474049 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 387/758] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:19 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:20.472535 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:20.473138 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:20.475354 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=64 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:20.480806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:20.481258 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.482020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:20.482452 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.491128 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:20.491750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:20.498519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:20.498974 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.499735 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:20.500195 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.504275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:20.617544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.625764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.627852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.629270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8ee409fb-2404-4dc6-94ee-87e8a306049c tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.161247 May 27 03:30:20.629816 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 372/759] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:20 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:20.639016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.647043 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9e0a8c4c-72ec-4cf8-88ed-673763799f0b tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.159863 May 27 03:30:20.647617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 388/760] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:20 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:21.060757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5309a90d-fb33-4904-bb44-3cfc4275ae47 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.061247 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5309a90d-fb33-4904-bb44-3cfc4275ae47 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.067464 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5309a90d-fb33-4904-bb44-3cfc4275ae47 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.067937 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5309a90d-fb33-4904-bb44-3cfc4275ae47 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.068686 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5309a90d-fb33-4904-bb44-3cfc4275ae47 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.069111 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5309a90d-fb33-4904-bb44-3cfc4275ae47 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.097744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5309a90d-fb33-4904-bb44-3cfc4275ae47 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/73388316-0592-403f-88ac-ad5a455ecbd5" status: 200 len: 194 microversion: 2.1 time: 0.040855 May 27 03:30:21.098316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 373/761] 10.222.0.62 () {58 vars in 1412 bytes} [Fri May 27 03:30:21 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/73388316-0592-403f-88ac-ad5a455ecbd5 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:21.108092 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.108613 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.114606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.115113 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.115910 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.116495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.217547 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-ead69e7e-1bdb-42ec-8bd1-d839581e9e4f req-44a8a8b7-4ec7-4da1-858a-6937df87cddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d97624-4fe0-488b-a0f3-99774e529c62", "name": "network-vif-plugged", "status": "completed", "tag": "31e8a7b7-f72a-49ad-a5a2-2f8d16acd296"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:21.229300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-ead69e7e-1bdb-42ec-8bd1-d839581e9e4f req-44a8a8b7-4ec7-4da1-858a-6937df87cddc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.229835 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-ead69e7e-1bdb-42ec-8bd1-d839581e9e4f req-44a8a8b7-4ec7-4da1-858a-6937df87cddc service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.233049 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lazy-loading 'services' on Instance uuid e31aba7f-3700-45f9-84a4-bef83da3d5b3 {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:30:21.246015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-ead69e7e-1bdb-42ec-8bd1-d839581e9e4f req-44a8a8b7-4ec7-4da1-858a-6937df87cddc service nova] Creating event network-vif-plugged:31e8a7b7-f72a-49ad-a5a2-2f8d16acd296 for instance f7d97624-4fe0-488b-a0f3-99774e529c62 on hv-cinder-82880 May 27 03:30:21.251757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-ead69e7e-1bdb-42ec-8bd1-d839581e9e4f req-44a8a8b7-4ec7-4da1-858a-6937df87cddc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039105 May 27 03:30:21.252487 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 374/762] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:21.318921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-82863d1f-4e5a-4bb1-8e5e-ce4d0876951d tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/73388316-0592-403f-88ac-ad5a455ecbd5" status: 202 len: 0 microversion: 2.1 time: 0.214358 May 27 03:30:21.319527 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 389/763] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:30:21 2022] DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments/73388316-0592-403f-88ac-ad5a455ecbd5 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:21.647492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.648209 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.654468 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.654855 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.655604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.656067 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.664900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.665605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.672298 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.672810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.674106 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.674545 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.805362 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.813529 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-eabd5341-d324-4be4-80e8-81437058ec43 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.152829 May 27 03:30:21.814775 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 390/764] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:21 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:21.820645 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.830598 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.832291 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.833566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f3ac7a9a-ab6d-44cc-b21c-b9670654f22f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.190807 May 27 03:30:21.834345 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 375/765] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:21 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:22.831222 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:22.831767 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:22.838341 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.838790 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.839546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.840016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.851429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:22.852069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:22.858470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.858917 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.859680 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.860145 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.973161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:22.980907 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d24228ce-af9c-4b59-a9a7-e6c61b59a547 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.153639 May 27 03:30:22.981470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 391/766] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:22 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:22.990963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:22.998816 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:23.000315 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:23.001449 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-11b363de-62d6-42a9-8995-6617fa0fa25f tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.153888 May 27 03:30:23.002807 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 376/767] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:22 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:23.539208 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-465c7499-544e-44d8-9053-c815be9bebb5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:23.540345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-465c7499-544e-44d8-9053-c815be9bebb5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:23.546289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465c7499-544e-44d8-9053-c815be9bebb5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.546744 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465c7499-544e-44d8-9053-c815be9bebb5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.547705 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465c7499-544e-44d8-9053-c815be9bebb5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.548103 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-465c7499-544e-44d8-9053-c815be9bebb5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.581772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-465c7499-544e-44d8-9053-c815be9bebb5 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046770 May 27 03:30:23.582330 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 392/768] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:30:23 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:30:23.705717 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-dd313d76-2165-4daf-a941-3fa4a0180791 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:23.706730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-dd313d76-2165-4daf-a941-3fa4a0180791 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:23.712736 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd313d76-2165-4daf-a941-3fa4a0180791 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.713248 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd313d76-2165-4daf-a941-3fa4a0180791 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.714084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd313d76-2165-4daf-a941-3fa4a0180791 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.714726 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dd313d76-2165-4daf-a941-3fa4a0180791 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.745713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-dd313d76-2165-4daf-a941-3fa4a0180791 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044532 May 27 03:30:23.746205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 377/769] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:30:23 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:30:23.806694 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:23.807195 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:23.814090 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.814566 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.815609 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.816339 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.845437 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:30:23.949072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f11d55a9-0b52-46dc-9545-0432e0113f45 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 204 len: 0 microversion: 2.1 time: 0.144937 May 27 03:30:23.950825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 393/770] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:30:23 2022] DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:30:23.966813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:23.967500 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:23.978730 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.980237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.981287 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.981953 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.001911 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:24.002759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:24.010003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:24.010693 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.011900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:24.012517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.180228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.193416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b2456304-653d-492e-868e-d18f2a4de107 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.198659 May 27 03:30:24.194243 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 394/771] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:23 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:24.200882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:24.202820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:24.211462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:24.212349 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.213503 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:24.214164 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.364292 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.372287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.373801 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.374964 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7d712cf0-50e3-4ca0-89c4-68f8e3fd623e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.179627 May 27 03:30:24.375528 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 395/772] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:24 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:24.389740 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.397622 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-935516a9-0972-4cf4-9eb6-16c4f7f0cdb3 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1673 microversion: 2.1 time: 0.442006 May 27 03:30:24.398170 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 378/773] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:23 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1673 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:25.211209 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:25.211846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:25.218417 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.218865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.220158 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.220599 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.350952 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:25.358508 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-69ab3e69-4205-4e0b-8450-8b5bfa87c5df tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.151279 May 27 03:30:25.359085 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 396/774] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:25 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:25.393249 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:25.393879 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:25.400432 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.400877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.401629 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.402060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.414337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:25.414935 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:25.421083 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.421561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.422423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.423497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.545759 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:25.554016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:25.554381 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:25.556018 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:25.557172 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-167b0890-1de7-4bb7-8deb-844599bd07ba tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1729 microversion: 2.20 time: 0.167802 May 27 03:30:25.557870 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 379/775] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:25 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:25.561905 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6fb1e567-3af7-4561-ac32-540fee1e14e2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1673 microversion: 2.1 time: 0.151329 May 27 03:30:25.562559 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 397/776] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:25 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:26.376830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:26.377458 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:26.383463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.383962 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.384722 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.385156 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.515356 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:26.518994 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=100 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:26.524019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e9c2064e-9aca-4d07-8a01-feb670474d74 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.151680 May 27 03:30:26.524581 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 380/777] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:26 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:26.575025 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:26.575934 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:26.580625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:26.581224 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:26.582709 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.583132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.584163 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.584372 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.587321 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.587768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.588585 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.589009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.810276 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:26.818926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-30683681-01e2-4c7d-b379-64f95a231d64 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1673 microversion: 2.1 time: 0.242204 May 27 03:30:26.828993 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 381/778] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:26 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:26.925814 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:26.939134 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:26.941001 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:26.942168 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0306fef1-0d96-466b-b1c4-89ab7ffc44c4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1716 microversion: 2.20 time: 0.370994 May 27 03:30:26.942723 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 398/779] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:30:26 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1716 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:27.518458 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-31449441-fe28-47a2-b683-7bf32e1d9fba req-ab869fb7-8a04-4fa7-8318-b4e24fdde6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31aba7f-3700-45f9-84a4-bef83da3d5b3", "name": "network-vif-deleted", "tag": "dbce52b7-89f4-4a12-9b4f-52599cf57a61"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:27.540892 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:27.541802 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:27.547294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-31449441-fe28-47a2-b683-7bf32e1d9fba req-ab869fb7-8a04-4fa7-8318-b4e24fdde6b1 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.548810 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-31449441-fe28-47a2-b683-7bf32e1d9fba req-ab869fb7-8a04-4fa7-8318-b4e24fdde6b1 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.550685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.551033 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.558966 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.559415 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.585520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-31449441-fe28-47a2-b683-7bf32e1d9fba req-ab869fb7-8a04-4fa7-8318-b4e24fdde6b1 service nova] Creating event network-vif-deleted:dbce52b7-89f4-4a12-9b4f-52599cf57a61 for instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 on hv-cinder-82880 May 27 03:30:27.590594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-31449441-fe28-47a2-b683-7bf32e1d9fba req-ab869fb7-8a04-4fa7-8318-b4e24fdde6b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077765 May 27 03:30:27.591185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 382/780] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:27.806860 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:27.815125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cfefedfb-59ce-41b5-8eb0-eadf0555f0da tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.277662 May 27 03:30:27.815639 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 399/781] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:27 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:27.837375 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:27.838059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:27.845310 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.845705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.846740 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.847171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.896236 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.896683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.897132 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lazy-loading 'fault' on Instance uuid e31aba7f-3700-45f9-84a4-bef83da3d5b3 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:30:27.962520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34132c9382a44cd97bc2c4e40c97eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b114bd896cc6469184097ef9300613da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:27.973096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-db4a3698-89c2-4f04-9e9b-31014e987db2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 200 len: 1327 microversion: 2.1 time: 0.140095 May 27 03:30:27.973992 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 383/782] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:27 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 1327 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:28.832701 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:28.833392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:28.842391 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:28.842850 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:28.843663 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:28.844170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:28.981385 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:28.989595 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-84c9c6ca-8341-4d3e-8e4d-490b4a05c11c tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.161360 May 27 03:30:28.990429 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 400/783] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:28 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:28.992256 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:28.992860 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:29.000813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:29.001264 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:29.002021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:29.002459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:29.015492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] HTTP exception thrown: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Request method failure captured: May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 HTTP/1.1 May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERcx2FBLYCbZdFjHvdTYVAJvtQzhZ-z9nO2Xx4WgeB_lSJRWPbgAJjie37OoOWlx-K7qvo4slwyfuo--u3mNe7X3Al4ESwWyGoZBgF6YaIMjeH0EUPASwhLBt5EzzdVmFrmBqqRGQfRjuFKkkxb9gqsqq3rC72Wv1HGi2IxIrCtS_o May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: b114bd896cc6469184097ef9300613da May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:30:29.017185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b114bd896cc6469184097ef9300613da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b114bd896cc6469184097ef9300613da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}] May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: b114bd896cc6469184097ef9300613da May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: b34132c9382a44cd97bc2c4e40c97eec May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:29.018784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'e31aba7f-3700-45f9-84a4-bef83da3d5b3'} May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:29.019601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:29.021202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:29.022598 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Returning 404 to user: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:29.022598 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1bc15d23-0d18-44ea-9038-a910c2cfa926 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 404 len: 111 microversion: 2.1 time: 0.031463 May 27 03:30:29.022598 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 384/784] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:28 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:30:29.027710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bc1cea1c-127e-4526-860e-27f751ce1779 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '.version_select at 0x7f40c0c17940>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:29.045442 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bc1cea1c-127e-4526-860e-27f751ce1779 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468440501" status: 202 len: 0 microversion: 2.1 time: 0.021432 May 27 03:30:29.046005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 401/785] 10.222.0.62 () {58 vars in 1217 bytes} [Fri May 27 03:30:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468440501 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:30.006986 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:30.008147 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:30.014129 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:30.014569 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:30.015312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:30.015735 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:30.157991 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:30.166928 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-09fd6c18-af89-45ec-aedd-9af291d498b4 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.163689 May 27 03:30:30.167861 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 385/786] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:30 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:31.186339 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:31.187007 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:31.194660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:31.195161 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:31.195957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:31.196389 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:31.260493 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-2b3059c6-e64c-4d47-8aaa-2a9f0721b9df req-01676b84-bfa4-4371-b843-4b705323c271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46fbddd-5f15-41b9-aaab-7fe260aa7bcd", "name": "network-vif-plugged", "status": "completed", "tag": "71e11d00-d642-48e1-acfd-a532d0199408"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:31.277734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2b3059c6-e64c-4d47-8aaa-2a9f0721b9df req-01676b84-bfa4-4371-b843-4b705323c271 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:31.278882 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-2b3059c6-e64c-4d47-8aaa-2a9f0721b9df req-01676b84-bfa4-4371-b843-4b705323c271 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:31.294690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-2b3059c6-e64c-4d47-8aaa-2a9f0721b9df req-01676b84-bfa4-4371-b843-4b705323c271 service nova] Creating event network-vif-plugged:71e11d00-d642-48e1-acfd-a532d0199408 for instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd on hv-cinder-82880 May 27 03:30:31.300943 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-2b3059c6-e64c-4d47-8aaa-2a9f0721b9df req-01676b84-bfa4-4371-b843-4b705323c271 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047925 May 27 03:30:31.301933 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 386/787] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:31.386241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:31.394139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-08f96102-b1cf-4099-81dd-211d7c2b6cff tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.212090 May 27 03:30:31.394794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 402/788] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:31 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:32.083610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:32.084211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:32.090372 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.090813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.091565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.092025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.105459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] HTTP exception thrown: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Request method failure captured: May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 HTTP/1.1 May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERcx2FBLYCbZdFjHvdTYVAJvtQzhZ-z9nO2Xx4WgeB_lSJRWPbgAJjie37OoOWlx-K7qvo4slwyfuo--u3mNe7X3Al4ESwWyGoZBgF6YaIMjeH0EUPASwhLBt5EzzdVmFrmBqqRGQfRjuFKkkxb9gqsqq3rC72Wv1HGi2IxIrCtS_o May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: b114bd896cc6469184097ef9300613da May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:30:32.107100 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b114bd896cc6469184097ef9300613da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b114bd896cc6469184097ef9300613da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}] May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: b114bd896cc6469184097ef9300613da May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: b34132c9382a44cd97bc2c4e40c97eec May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.108666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'e31aba7f-3700-45f9-84a4-bef83da3d5b3'} May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:32.109754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.111028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:32.113162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Returning 404 to user: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:32.113162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9b7db259-1497-488f-a669-80408d7f9a8b tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 404 len: 111 microversion: 2.1 time: 0.030305 May 27 03:30:32.113162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 387/789] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:30:32 2022] DELETE /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:32.117789 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:32.118403 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: e31aba7f-3700-45f9-84a4-bef83da3d5b3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:32.124602 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.125059 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.126326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.126830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.140222 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] HTTP exception thrown: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Request method failure captured: May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 HTTP/1.1 May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERcx2FBLYCbZdFjHvdTYVAJvtQzhZ-z9nO2Xx4WgeB_lSJRWPbgAJjie37OoOWlx-K7qvo4slwyfuo--u3mNe7X3Al4ESwWyGoZBgF6YaIMjeH0EUPASwhLBt5EzzdVmFrmBqqRGQfRjuFKkkxb9gqsqq3rC72Wv1HGi2IxIrCtS_o May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: b114bd896cc6469184097ef9300613da May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:30:32.142510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b114bd896cc6469184097ef9300613da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b114bd896cc6469184097ef9300613da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}] May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: b114bd896cc6469184097ef9300613da May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: b34132c9382a44cd97bc2c4e40c97eec May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.144071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'e31aba7f-3700-45f9-84a4-bef83da3d5b3'} May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:32.148094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. May 27 03:30:32.149532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:32.150930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Returning 404 to user: Instance e31aba7f-3700-45f9-84a4-bef83da3d5b3 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:32.150930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ceb3e547-5d2b-49ea-bf87-133c6f602fa2 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3" status: 404 len: 111 microversion: 2.1 time: 0.030061 May 27 03:30:32.150930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 403/790] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:32 2022] GET /compute/v2.1/servers/e31aba7f-3700-45f9-84a4-bef83da3d5b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:30:32.411233 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:32.411852 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:32.418254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.418690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.419440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.419892 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.552142 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:32.559552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-dbc20d9b-2757-4e1d-82f0-ef4883cce197 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1574 microversion: 2.1 time: 0.152142 May 27 03:30:32.560133 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 388/791] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:32 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:33.281089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:33.281580 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:33.288986 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.289433 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.290193 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.290628 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.294709 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:33.305363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] HTTP exception thrown: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Request method failure captured: May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: DELETE /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f HTTP/1.1 May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikERcx2FBLYCbZdFjHvdTYVAJvtQzhZ-z9nO2Xx4WgeB_lSJRWPbgAJjie37OoOWlx-K7qvo4slwyfuo--u3mNe7X3Al4ESwWyGoZBgF6YaIMjeH0EUPASwhLBt5EzzdVmFrmBqqRGQfRjuFKkkxb9gqsqq3rC72Wv1HGi2IxIrCtS_o May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: b114bd896cc6469184097ef9300613da May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:30:33.306997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b114bd896cc6469184097ef9300613da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b114bd896cc6469184097ef9300613da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}] May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: b114bd896cc6469184097ef9300613da May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: b34132c9382a44cd97bc2c4e40c97eec May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.308584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '15a8db13-6978-4562-918e-29f8ca94ef3f'} May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:33.309448 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.310820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:30:33.312240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Returning 404 to user: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:33.312240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-338054aa-9530-4417-a569-2d667d7f0973 tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "DELETE /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 404 len: 111 microversion: 2.1 time: 0.031198 May 27 03:30:33.312240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 404/792] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:30:33 2022] DELETE /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:33.317302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:33.317951 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] [instance: 15a8db13-6978-4562-918e-29f8ca94ef3f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:33.323792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.324272 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.325014 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.325443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.338899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] HTTP exception thrown: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Request method failure captured: May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f HTTP/1.1 May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikERcx2FBLYCbZdFjHvdTYVAJvtQzhZ-z9nO2Xx4WgeB_lSJRWPbgAJjie37OoOWlx-K7qvo4slwyfuo--u3mNe7X3Al4ESwWyGoZBgF6YaIMjeH0EUPASwhLBt5EzzdVmFrmBqqRGQfRjuFKkkxb9gqsqq3rC72Wv1HGi2IxIrCtS_o May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: b114bd896cc6469184097ef9300613da May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:30:33.340534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b114bd896cc6469184097ef9300613da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b114bd896cc6469184097ef9300613da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b114bd896cc6469184097ef9300613da"}]}] May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: b114bd896cc6469184097ef9300613da May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050876474 May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: b34132c9382a44cd97bc2c4e40c97eec May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeTestJSON-2050876474-project May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.342056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '15a8db13-6978-4562-918e-29f8ca94ef3f'} May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:33.342921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. May 27 03:30:33.344200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:30:33.345250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] Returning 404 to user: Instance 15a8db13-6978-4562-918e-29f8ca94ef3f could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:33.345250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0c8b52e1-e9af-4b2f-8ba9-538e2c9e49cd tempest-AttachVolumeTestJSON-2050876474 tempest-AttachVolumeTestJSON-2050876474-project] 10.222.0.62 "GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f" status: 404 len: 111 microversion: 2.1 time: 0.028718 May 27 03:30:33.345250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 389/793] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:33 2022] GET /compute/v2.1/servers/15a8db13-6978-4562-918e-29f8ca94ef3f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:33.577565 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:33.578247 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:33.585252 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.585891 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.586661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.588135 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.813818 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:33.822363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bb62dbfe-74eb-4c10-ae7f-d1be1d723529 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1561 microversion: 2.1 time: 0.249045 May 27 03:30:33.822930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 405/794] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:33 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:42.801170 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-92e10af8-337b-4d40-bc50-b2be92764499 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: .version_select at 0x7f40c035dee0>, body: {"keypair": {"name": "tempest-keypair-483518943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvMwP4+HHHlxA6gUwyl1KUrVg+8cubdmqmRUmBnQf21KqBBiMNpFkDVqzSK35oyI64egDn1chOS8gGNFZPwTJyGYEYWL+n7c9ObkgJtB4uT3+LQ2oT2E3e1hcSaCvt/5Q=="}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:42.815724 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-92e10af8-337b-4d40-bc50-b2be92764499 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:30:42.819749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-92e10af8-337b-4d40-bc50-b2be92764499 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:30:42.864747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-92e10af8-337b-4d40-bc50-b2be92764499 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180284 May 27 03:30:42.865350 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 390/795] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:30:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:44.264133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1327911259", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fca8f91-27a5-4216-bd00-e734abe0021c"}], "security_groups": [{"name": "tempest-securitygroup--512239697"}], "key_name": "tempest-keypair-483518943", "user_data": "}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:44.271560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:44.272426 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=7 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:44.367577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] validate_networks() for [('5fca8f91-27a5-4216-bd00-e734abe0021c', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:30:44.787153 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:30:44.787572 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:30:44.788077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:30:44.788480 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:30:44.788883 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:30:44.797577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:44.798021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:44.798810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:44.799245 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:44.817369 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:30:44.821348 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:30:44.833613 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:30:44.836209 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:30:44.880992 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3d3a1ca7-2d75-4d66-b974-958b56252c14 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621077 May 27 03:30:44.881627 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 406/796] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:30:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:30:44.888636 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=36 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:44.894009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-61428972-ec96-4c9e-9a42-93f7831a8c51 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:44.894731 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-61428972-ec96-4c9e-9a42-93f7831a8c51 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:44.959710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-61428972-ec96-4c9e-9a42-93f7831a8c51 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:44.967787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-61428972-ec96-4c9e-9a42-93f7831a8c51 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1241 microversion: 2.1 time: 0.079701 May 27 03:30:44.968405 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 391/797] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:44 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:45.986169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:45.987441 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:45.994743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:45.995546 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:45.996643 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:45.997386 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:46.076992 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:46.088145 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-470a99af-282e-4e1e-a782-0d9c7783aeb8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1301 microversion: 2.1 time: 0.106446 May 27 03:30:46.088919 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 407/798] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:45 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:47.106396 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:47.106973 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:47.114319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:47.121163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:47.121163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:47.121163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:47.331025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:47.338652 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-909e710c-284d-4f08-a4e3-10c480582859 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.236159 May 27 03:30:47.339422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 392/799] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:47 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:47.701417 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-3ae160f3-56b2-49b3-ac38-f1158e1ffa71 req-9c0c3564-2fa9-4083-9ad0-ae26e4b9a671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4725f793-67be-47c7-a4c6-07ccb2be4a57", "tag": "572284c7-6a4b-4975-93f9-dc7f2d18f828"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:47.726399 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3ae160f3-56b2-49b3-ac38-f1158e1ffa71 req-9c0c3564-2fa9-4083-9ad0-ae26e4b9a671 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:47.726926 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3ae160f3-56b2-49b3-ac38-f1158e1ffa71 req-9c0c3564-2fa9-4083-9ad0-ae26e4b9a671 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:47.741293 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-3ae160f3-56b2-49b3-ac38-f1158e1ffa71 req-9c0c3564-2fa9-4083-9ad0-ae26e4b9a671 service nova] Creating event network-changed:572284c7-6a4b-4975-93f9-dc7f2d18f828 for instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 on hv-cinder-82880 May 27 03:30:47.746494 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-3ae160f3-56b2-49b3-ac38-f1158e1ffa71 req-9c0c3564-2fa9-4083-9ad0-ae26e4b9a671 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060741 May 27 03:30:47.752028 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 408/800] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:48.356308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:48.357023 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:48.364283 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.364748 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.365492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.365925 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.496521 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:48.504007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4cccafa4-c710-4242-a62e-5e108d3f8479 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.151485 May 27 03:30:48.504556 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 393/801] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:48 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:49.521777 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:49.522676 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:49.530901 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:49.531351 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:49.532344 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:49.532806 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:49.663554 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:49.671167 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-db045d45-4e45-49f4-aae9-8390a7f36b0d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.154270 May 27 03:30:49.671734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 409/802] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:49 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:50.689607 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:50.690240 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:50.692526 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:50.697946 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.698391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.699155 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.699617 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:50.845869 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-177ad035-8a07-4f02-95bf-98b0408c63c6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.160956 May 27 03:30:50.846373 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 394/803] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:50 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:51.863029 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:51.864535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:51.876005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:51.876005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:51.876005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:51.876005 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.009159 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:52.016728 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f48a3c90-0790-44fd-8c10-b8f6e60bbeda tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.158170 May 27 03:30:52.017331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 410/804] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:51 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:53.033391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:53.034002 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:53.041339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:53.041795 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:53.042552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:53.042982 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:53.178779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:53.186582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-00d10a4c-0235-493f-ad0c-1a687b259ff3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.157029 May 27 03:30:53.187116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 395/805] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:53 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:53.375022 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-058bc5e2-d778-4278-aa33-f01aa82ceeb8 req-5ed3c642-5a20-4ca2-82ea-848ac5b08aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4725f793-67be-47c7-a4c6-07ccb2be4a57", "name": "network-vif-plugged", "status": "completed", "tag": "572284c7-6a4b-4975-93f9-dc7f2d18f828"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:53.386763 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-058bc5e2-d778-4278-aa33-f01aa82ceeb8 req-5ed3c642-5a20-4ca2-82ea-848ac5b08aca service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:53.387096 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-058bc5e2-d778-4278-aa33-f01aa82ceeb8 req-5ed3c642-5a20-4ca2-82ea-848ac5b08aca service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:53.401196 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-058bc5e2-d778-4278-aa33-f01aa82ceeb8 req-5ed3c642-5a20-4ca2-82ea-848ac5b08aca service nova] Creating event network-vif-plugged:572284c7-6a4b-4975-93f9-dc7f2d18f828 for instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 on hv-cinder-82880 May 27 03:30:53.406660 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-058bc5e2-d778-4278-aa33-f01aa82ceeb8 req-5ed3c642-5a20-4ca2-82ea-848ac5b08aca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035168 May 27 03:30:53.408054 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 411/806] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:30:54.204402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:54.205424 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:54.212565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.213014 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.213804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.214239 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.346999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:54.354922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4efcea82-f827-49e1-9c0d-337715bfb608 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.154388 May 27 03:30:54.355484 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 396/807] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:54 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:55.369605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:55.370360 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=6 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:55.374600 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:55.375301 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:55.382878 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:55.383323 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:55.384321 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:55.385166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:55.544603 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:55.552597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2ddc4112-7a37-4363-9ce3-87cb4e4d432d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1366 microversion: 2.1 time: 0.184345 May 27 03:30:55.553270 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 412/808] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:55 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:56.569666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:56.570181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:56.572194 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:56.577792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.578215 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.578964 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.579407 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.713511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:56.726419 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-16f2e5ab-27c6-4e9b-94c7-a9cb2399d302 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1556 microversion: 2.1 time: 0.160587 May 27 03:30:56.726990 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 397/809] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:30:56 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:56.743525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9cd727d2-3fb5-4c55-85c3-860c955996be tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:56.744115 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9cd727d2-3fb5-4c55-85c3-860c955996be tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:56.753112 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9cd727d2-3fb5-4c55-85c3-860c955996be tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.754238 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9cd727d2-3fb5-4c55-85c3-860c955996be tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.755853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9cd727d2-3fb5-4c55-85c3-860c955996be tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.756841 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9cd727d2-3fb5-4c55-85c3-860c955996be tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.840582 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9cd727d2-3fb5-4c55-85c3-860c955996be tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101295 May 27 03:30:56.841171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 413/810] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:30:56 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:57.775180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-f191761e-efe1-4a12-a8a4-04111bc136f1 req-a59a8e5b-9c30-44b8-86ea-98b4c3852b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4725f793-67be-47c7-a4c6-07ccb2be4a57", "tag": "572284c7-6a4b-4975-93f9-dc7f2d18f828"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:57.783664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f191761e-efe1-4a12-a8a4-04111bc136f1 req-a59a8e5b-9c30-44b8-86ea-98b4c3852b0e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:57.784150 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f191761e-efe1-4a12-a8a4-04111bc136f1 req-a59a8e5b-9c30-44b8-86ea-98b4c3852b0e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:57.795420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-f191761e-efe1-4a12-a8a4-04111bc136f1 req-a59a8e5b-9c30-44b8-86ea-98b4c3852b0e service nova] Creating event network-changed:572284c7-6a4b-4975-93f9-dc7f2d18f828 for instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 on hv-cinder-82880 May 27 03:30:57.801292 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-f191761e-efe1-4a12-a8a4-04111bc136f1 req-a59a8e5b-9c30-44b8-86ea-98b4c3852b0e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029959 May 27 03:30:57.802082 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 398/811] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:59.938658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2f7fc112-982d-4def-b0a0-f8cc1e829780 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:59.940286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2f7fc112-982d-4def-b0a0-f8cc1e829780 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:59.946303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f7fc112-982d-4def-b0a0-f8cc1e829780 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:59.946751 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f7fc112-982d-4def-b0a0-f8cc1e829780 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:59.947504 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f7fc112-982d-4def-b0a0-f8cc1e829780 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:59.947965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f7fc112-982d-4def-b0a0-f8cc1e829780 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:59.976706 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2f7fc112-982d-4def-b0a0-f8cc1e829780 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042720 May 27 03:30:59.977251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 414/812] 10.222.0.62 () {60 vars in 1342 bytes} [Fri May 27 03:30:59 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:00.035515 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:00.036128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:00.043131 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:00.043583 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:00.044355 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:00.044788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:00.071326 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:31:00.147205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c3398029-2301-4210-b779-af4b8523d58e tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 204 len: 0 microversion: 2.20 time: 0.115991 May 27 03:31:00.148073 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 399/813] 10.222.0.62 () {60 vars in 1279 bytes} [Fri May 27 03:31:00 2022] DELETE /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:31:00.156794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:00.157451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:00.163983 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:00.164432 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:00.165207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:00.165775 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:00.291346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:00.299888 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:00.301393 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:00.302536 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a1ef998c-5764-4662-aa17-8e2f84e5a546 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.150117 May 27 03:31:00.303097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 415/814] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:31:00 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:31:01.321743 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:01.322448 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:01.328906 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:01.329358 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:01.330776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:01.331212 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:01.461028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:01.469751 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:01.471233 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:01.472548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-38262cac-514c-46e6-8030-6b8532e75730 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.154996 May 27 03:31:01.473343 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 400/815] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:31:01 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:31:02.490989 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:02.491543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:02.498595 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:02.499042 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:02.499863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:02.500296 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:02.639085 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:02.647593 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:02.649126 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '720bd38555404aafa93db5ae49b13acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3931210010614a1f987661568f29e851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:02.650284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ef0b5582-cded-4a2e-a5e8-c60722d87fc4 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 200 len: 1722 microversion: 2.20 time: 0.163440 May 27 03:31:02.650840 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 416/816] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:31:02 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:31:03.131735 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-8ed253e9-1e42-42ee-89ac-5b649cca5e6d req-8616ab1c-f20a-466e-840c-6c655e173fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d97624-4fe0-488b-a0f3-99774e529c62", "name": "network-vif-deleted", "tag": "31e8a7b7-f72a-49ad-a5a2-2f8d16acd296"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:03.141189 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8ed253e9-1e42-42ee-89ac-5b649cca5e6d req-8616ab1c-f20a-466e-840c-6c655e173fff service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.141539 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8ed253e9-1e42-42ee-89ac-5b649cca5e6d req-8616ab1c-f20a-466e-840c-6c655e173fff service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.153157 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-8ed253e9-1e42-42ee-89ac-5b649cca5e6d req-8616ab1c-f20a-466e-840c-6c655e173fff service nova] Creating event network-vif-deleted:31e8a7b7-f72a-49ad-a5a2-2f8d16acd296 for instance f7d97624-4fe0-488b-a0f3-99774e529c62 on hv-cinder-82880 May 27 03:31:03.157814 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-8ed253e9-1e42-42ee-89ac-5b649cca5e6d req-8616ab1c-f20a-466e-840c-6c655e173fff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029680 May 27 03:31:03.159023 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 401/817] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:03.668789 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:03.669398 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:03.678373 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.678825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.679668 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.680409 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.694850 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] HTTP exception thrown: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Request method failure captured: May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 HTTP/1.1 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEROcAQPsnVyoFwkzR7ftYrwYY1jpz6iKJpM0ZObtCEcLg4xTW__8HYnghm_GhGIFc_rjC2HnbTXvbGoaIlUnEE-BKyhqBGBTPNwLYvFuORaqqRAYSJs1nqnvPJbWJgBblPm22trMduQZVZFkq-1ebJX6HhKCyLwt36Hopo9KOmdaw8 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 3931210010614a1f987661568f29e851 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:31:03.696569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3931210010614a1f987661568f29e851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3931210010614a1f987661568f29e851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}] May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 3931210010614a1f987661568f29e851 May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 720bd38555404aafa93db5ae49b13acf May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:03.698324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'f7d97624-4fe0-488b-a0f3-99774e529c62'} May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:03.703109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:03.705950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:03.708287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Returning 404 to user: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:03.708287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-23980f91-bb31-458e-b425-f47d6c751bf2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 404 len: 111 microversion: 2.20 time: 0.033225 May 27 03:31:03.708287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 417/818] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:31:03 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:03.710219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-35e189a8-ac15-45b4-addd-deabcf5810b2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '.version_select at 0x7f40c04b2700>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:03.729939 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-35e189a8-ac15-45b4-addd-deabcf5810b2 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-960575419" status: 204 len: 0 microversion: 2.20 time: 0.026492 May 27 03:31:03.730705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 402/819] 10.222.0.62 () {60 vars in 1258 bytes} [Fri May 27 03:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-960575419 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 03:31:05.510251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:05.510736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:05.517430 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.517874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.518625 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.519058 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.532372 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] HTTP exception thrown: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Request method failure captured: May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: DELETE /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 HTTP/1.1 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEROcAQPsnVyoFwkzR7ftYrwYY1jpz6iKJpM0ZObtCEcLg4xTW__8HYnghm_GhGIFc_rjC2HnbTXvbGoaIlUnEE-BKyhqBGBTPNwLYvFuORaqqRAYSJs1nqnvPJbWJgBblPm22trMduQZVZFkq-1ebJX6HhKCyLwt36Hopo9KOmdaw8 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 3931210010614a1f987661568f29e851 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:31:05.534402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3931210010614a1f987661568f29e851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3931210010614a1f987661568f29e851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}] May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 3931210010614a1f987661568f29e851 May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 720bd38555404aafa93db5ae49b13acf May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.536102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'f7d97624-4fe0-488b-a0f3-99774e529c62'} May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:05.537075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.538497 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:05.540227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Returning 404 to user: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:05.540227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2db0280b-ebff-48d2-982e-5daa45522221 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 404 len: 111 microversion: 2.20 time: 0.029368 May 27 03:31:05.540227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 418/820] 10.222.0.62 () {60 vars in 1279 bytes} [Fri May 27 03:31:05 2022] DELETE /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:05.544587 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:05.545306 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: f7d97624-4fe0-488b-a0f3-99774e529c62] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:05.552086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.552529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.553312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.553744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.566957 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] HTTP exception thrown: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Request method failure captured: May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 HTTP/1.1 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEROcAQPsnVyoFwkzR7ftYrwYY1jpz6iKJpM0ZObtCEcLg4xTW__8HYnghm_GhGIFc_rjC2HnbTXvbGoaIlUnEE-BKyhqBGBTPNwLYvFuORaqqRAYSJs1nqnvPJbWJgBblPm22trMduQZVZFkq-1ebJX6HhKCyLwt36Hopo9KOmdaw8 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 3931210010614a1f987661568f29e851 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:31:05.568576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3931210010614a1f987661568f29e851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3931210010614a1f987661568f29e851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}] May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 3931210010614a1f987661568f29e851 May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 720bd38555404aafa93db5ae49b13acf May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.570162 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'f7d97624-4fe0-488b-a0f3-99774e529c62'} May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:05.571168 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. May 27 03:31:05.572640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:05.574001 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Returning 404 to user: Instance f7d97624-4fe0-488b-a0f3-99774e529c62 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:05.574001 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-19a0f56d-69ca-40bf-b4db-0f40d85dd125 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62" status: 404 len: 111 microversion: 2.20 time: 0.029643 May 27 03:31:05.574001 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 403/821] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:31:05 2022] GET /compute/v2.1/servers/f7d97624-4fe0-488b-a0f3-99774e529c62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:06.701809 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:06.702334 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:06.708734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.709178 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.709934 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.710369 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.723513 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] HTTP exception thrown: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Request method failure captured: May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: DELETE /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 HTTP/1.1 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEROcAQPsnVyoFwkzR7ftYrwYY1jpz6iKJpM0ZObtCEcLg4xTW__8HYnghm_GhGIFc_rjC2HnbTXvbGoaIlUnEE-BKyhqBGBTPNwLYvFuORaqqRAYSJs1nqnvPJbWJgBblPm22trMduQZVZFkq-1ebJX6HhKCyLwt36Hopo9KOmdaw8 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 3931210010614a1f987661568f29e851 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:31:06.727998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3931210010614a1f987661568f29e851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3931210010614a1f987661568f29e851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}] May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 3931210010614a1f987661568f29e851 May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 720bd38555404aafa93db5ae49b13acf May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.729629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '668956ce-1a9e-43d1-a8d9-6ed759ad30f3'} May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:06.730486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.731932 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:06.733363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Returning 404 to user: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:06.733363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2c5d9f09-db0c-4248-8355-d63cb76996d6 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "DELETE /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 404 len: 111 microversion: 2.20 time: 0.028449 May 27 03:31:06.733363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 419/822] 10.222.0.62 () {60 vars in 1279 bytes} [Fri May 27 03:31:06 2022] DELETE /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:06.734844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:06.735451 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] [instance: 668956ce-1a9e-43d1-a8d9-6ed759ad30f3] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:06.742563 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.743010 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.743765 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.744228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.758058 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] HTTP exception thrown: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Request method failure captured: May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 HTTP/1.1 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEROcAQPsnVyoFwkzR7ftYrwYY1jpz6iKJpM0ZObtCEcLg4xTW__8HYnghm_GhGIFc_rjC2HnbTXvbGoaIlUnEE-BKyhqBGBTPNwLYvFuORaqqRAYSJs1nqnvPJbWJgBblPm22trMduQZVZFkq-1ebJX6HhKCyLwt36Hopo9KOmdaw8 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 3931210010614a1f987661568f29e851 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:31:06.759565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3931210010614a1f987661568f29e851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3931210010614a1f987661568f29e851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3931210010614a1f987661568f29e851"}]}] May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 3931210010614a1f987661568f29e851 May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1677734269 May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 720bd38555404aafa93db5ae49b13acf May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1677734269-project May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.762784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '668956ce-1a9e-43d1-a8d9-6ed759ad30f3'} May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:06.763660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. May 27 03:31:06.765066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:06.766309 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] Returning 404 to user: Instance 668956ce-1a9e-43d1-a8d9-6ed759ad30f3 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:06.766309 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-59be67a6-c6cf-47d9-8127-eb09c1aee135 tempest-AttachVolumeShelveTestJSON-1677734269 tempest-AttachVolumeShelveTestJSON-1677734269-project] 10.222.0.62 "GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3" status: 404 len: 111 microversion: 2.20 time: 0.029941 May 27 03:31:06.766309 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 404/823] 10.222.0.62 () {60 vars in 1276 bytes} [Fri May 27 03:31:06 2022] GET /compute/v2.1/servers/668956ce-1a9e-43d1-a8d9-6ed759ad30f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 03:31:09.493584 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:09.494709 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:09.501977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.502431 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.503666 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.504174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.532207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:31:09.654273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f8b198b1-4c4f-457f-ac1d-3400af0eb3eb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 204 len: 0 microversion: 2.1 time: 0.164197 May 27 03:31:09.660275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 420/824] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:31:09 2022] DELETE /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:31:09.669554 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:09.670773 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:09.684015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.684015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.684015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.684015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.920214 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:09.929334 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3ddb54c4-6664-4043-a2ee-2a342dab2509 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1576 microversion: 2.1 time: 0.265031 May 27 03:31:09.929900 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 405/825] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:09 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1576 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:10.946784 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:10.947481 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:10.954190 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.955206 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.955996 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.956428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:11.099136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:11.106819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-14a4c336-96a9-4f12-aaae-80709bdaf9ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1576 microversion: 2.1 time: 0.164171 May 27 03:31:11.107381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 421/826] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:10 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:12.126709 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:12.127696 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:12.135745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:12.136494 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:12.137708 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:12.138338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:12.240175 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:12.250184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d47611df-e6d7-4917-9c73-d30a3f388a6e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1510 microversion: 2.1 time: 0.129358 May 27 03:31:12.251042 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 406/827] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:12 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1510 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:12.470547 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-3801eeba-a254-45cc-8e93-83f1f222e0e7 req-8d2c5a10-263d-49df-9722-639330f90697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b74f0adb-3455-49d5-9bae-908876fbd9a9", "name": "network-vif-deleted", "tag": "7e5c7f67-26e9-494e-9521-c8fe58036825"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:12.481237 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3801eeba-a254-45cc-8e93-83f1f222e0e7 req-8d2c5a10-263d-49df-9722-639330f90697 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:12.481747 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3801eeba-a254-45cc-8e93-83f1f222e0e7 req-8d2c5a10-263d-49df-9722-639330f90697 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:12.497524 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-3801eeba-a254-45cc-8e93-83f1f222e0e7 req-8d2c5a10-263d-49df-9722-639330f90697 service nova] Creating event network-vif-deleted:7e5c7f67-26e9-494e-9521-c8fe58036825 for instance b74f0adb-3455-49d5-9bae-908876fbd9a9 on hv-cinder-82880 May 27 03:31:12.511279 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-3801eeba-a254-45cc-8e93-83f1f222e0e7 req-8d2c5a10-263d-49df-9722-639330f90697 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044524 May 27 03:31:12.511917 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 422/828] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:13.269560 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:13.270184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:13.279114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:13.279622 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:13.280526 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:13.288156 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:13.327277 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:13.327723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:13.328204 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lazy-loading 'fault' on Instance uuid b74f0adb-3455-49d5-9bae-908876fbd9a9 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:31:13.377512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:13.386320 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e9c287bc-f100-43dd-a587-00e6086ecc79 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 200 len: 1231 microversion: 2.1 time: 0.122418 May 27 03:31:13.386961 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 407/829] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:13 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 1231 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:14.404139 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:14.404856 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:14.407371 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:14.412843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:14.413346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:14.414071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:14.414507 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:14.419026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:14.430862 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] HTTP exception thrown: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Request method failure captured: May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 HTTP/1.1 May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEVVO8C6qaG6FH18PPWymXNffParFeL03_EnsgnqwS6FJrySRunze2kOheW0nsl3FEkYErStA-H1BtL-7wDnmdwWW8NTb-O5QWgJVHyhMLVPrfcitaPZOgLdy7APaPc_kfEHnQd6wU6B7mdm55dXs5Taf1F0MQyGaKXfh6Qs2i3IIck May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:31:14.432629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}] May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-TestVolumeBootPattern-597250560 May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-TestVolumeBootPattern-597250560-project May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 5c8ad338eb7b47c18dcb86f287e28858 May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-TestVolumeBootPattern-597250560-project May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:31:14.434175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'b74f0adb-3455-49d5-9bae-908876fbd9a9'} May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:14.435063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:31:14.436486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:31:14.438032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Returning 404 to user: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:14.438032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2974c9e4-cbf4-4715-a33d-ac345d8d3b4b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 404 len: 111 microversion: 2.1 time: 0.034063 May 27 03:31:14.438032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 423/830] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:14 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:31:14.530818 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2048753267", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1096312396", "security_groups": [{"name": "tempest-secgroup-smoke-73264536"}], "block_device_mapping_v2": [{"uuid": "b31e1cc7-d675-4d5f-99ce-5c35c15bae96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "561895ec-13c2-4737-9f4c-a28189f41261"}]}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:14.643503 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] validate_networks() for [('561895ec-13c2-4737-9f4c-a28189f41261', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:31:15.112187 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:31:15.112604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:31:15.113069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:31:15.113470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:31:15.113898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:31:15.122625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:15.123068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:15.123893 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:15.124330 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:15.131626 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:15.144205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:31:15.148158 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for user 5c8ad338eb7b47c18dcb86f287e28858 and project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:31:15.204837 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:31:15.206915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b31e1cc7-d675-4d5f-99ce-5c35c15bae96',volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:31:15.329600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d14108e8-97d1-45bc-9891-f926c97e8c41 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.802669 May 27 03:31:15.330236 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 408/831] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:31:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:31:15.340673 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-1bef495c-a17f-47c3-befc-da2c695b8ab9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:15.341491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-1bef495c-a17f-47c3-befc-da2c695b8ab9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:15.406121 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-1bef495c-a17f-47c3-befc-da2c695b8ab9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:15.413882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-1bef495c-a17f-47c3-befc-da2c695b8ab9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1095 microversion: 2.1 time: 0.077626 May 27 03:31:15.414453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 424/832] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:15 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:16.430540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:16.431140 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:16.438044 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:16.438998 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:16.439747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:16.440203 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:16.509442 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:16.516774 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c0123659-a08d-451e-8169-53b1864673c7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1211 microversion: 2.1 time: 0.090093 May 27 03:31:16.517323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 409/833] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:16 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:17.534302 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:17.534916 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:17.542421 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:17.542871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:17.543637 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:17.544099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:17.607602 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:17.615881 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ff2e0220-2a83-49db-af61-49ff6ec59b45 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1211 microversion: 2.1 time: 0.086035 May 27 03:31:17.616441 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 425/834] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:17 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:18.632368 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:18.632973 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:18.639339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:18.639778 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:18.640557 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:18.640988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:18.700512 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:18.708373 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1f6b2849-94bf-44b4-9184-e5231fec292c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1211 microversion: 2.1 time: 0.079895 May 27 03:31:18.708921 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 410/835] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:18 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:19.727468 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:19.729026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:19.743899 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:19.744397 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:19.745364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:19.745977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:19.900617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:19.908231 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e4048549-d83b-405b-9c39-1090e7811d0a tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1277 microversion: 2.1 time: 0.186243 May 27 03:31:19.908791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 426/836] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:19 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:31:20.335511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-f702ac0e-0562-4c2f-8972-f6899fef6055 req-643de92d-f2c3-4003-a3a2-b9486616d72f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594cf2db-0111-498c-aa48-6e11dbd811d2", "tag": "15a5d120-c2cb-4d46-a227-596e6c129738"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:20.345331 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f702ac0e-0562-4c2f-8972-f6899fef6055 req-643de92d-f2c3-4003-a3a2-b9486616d72f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:20.345768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-f702ac0e-0562-4c2f-8972-f6899fef6055 req-643de92d-f2c3-4003-a3a2-b9486616d72f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:20.357347 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-f702ac0e-0562-4c2f-8972-f6899fef6055 req-643de92d-f2c3-4003-a3a2-b9486616d72f service nova] Creating event network-changed:15a5d120-c2cb-4d46-a227-596e6c129738 for instance 594cf2db-0111-498c-aa48-6e11dbd811d2 on hv-cinder-82880 May 27 03:31:20.363191 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-f702ac0e-0562-4c2f-8972-f6899fef6055 req-643de92d-f2c3-4003-a3a2-b9486616d72f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031414 May 27 03:31:20.363776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 411/837] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:20.925214 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:20.925827 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:20.932359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:20.932803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:20.933558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:20.933993 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:21.064251 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:21.071851 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b9a1e39b-101d-4ab0-8186-8a9ea4ab103f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.151000 May 27 03:31:21.072423 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 427/838] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:20 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:22.089726 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:22.090427 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:22.092362 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:22.098573 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:22.099028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:22.099777 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:22.100237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:22.233233 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:22.240671 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b52b54d1-24d5-4a88-b414-f01fdf5a37ba tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.155683 May 27 03:31:22.241234 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 412/839] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:22 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:31:23.257338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:23.257939 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:23.264446 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:23.264895 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:23.266184 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:23.266627 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:23.396208 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:23.403658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5e733efc-63e4-43a0-93f5-8d7c0e9064a5 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.150193 May 27 03:31:23.404256 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 428/840] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:23 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:24.420842 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:24.421432 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:24.428558 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:24.429008 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:24.429779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:24.430212 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:24.561477 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:24.569253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-727b8767-3e89-48dc-82df-2219e53ca4b2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.152242 May 27 03:31:24.569816 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 413/841] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:24 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:25.584744 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:25.589015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:25.589450 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:25.595658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:25.596453 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:25.597218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:25.597647 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:25.728328 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:25.736252 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-414090d3-11a3-43dd-89ae-f2a71ce1b324 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.152718 May 27 03:31:25.736811 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 429/842] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:25 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:26.752625 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:26.753237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:26.755129 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:26.755787 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:26.762316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:26.762770 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:26.763538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:26.764011 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:26.896001 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:26.903647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d8b44670-2556-45c1-bc2a-beca7d900f2e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.155334 May 27 03:31:26.904253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 414/843] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:26 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:27.920515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:27.921110 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:27.927791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:27.928279 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:27.929038 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:27.929475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:28.058666 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:28.066926 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c51d6121-ab63-45ee-ac50-b1b4921df104 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.150245 May 27 03:31:28.067486 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 430/844] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:27 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:29.084398 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:29.085008 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:29.091400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:29.091875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:29.092630 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:29.093064 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:29.221463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:29.228919 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bcfbd69a-71fa-47af-95f5-4af8408f77d3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.148390 May 27 03:31:29.229485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 415/845] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:29 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:30.246551 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:30.247088 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:30.253670 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:30.254122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:30.254916 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:30.255354 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:30.381803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:30.389296 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a242be44-7b8f-439a-870a-dff03331c3c8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.146689 May 27 03:31:30.389866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 431/846] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:30 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:31.406445 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:31.407045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:31.413549 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:31.413989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:31.414737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:31.415159 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:31.544152 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:31.552183 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4623c817-d264-4923-847d-a34f133b13e2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.149492 May 27 03:31:31.552747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 416/847] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:31 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:32.570362 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:32.570971 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:32.578361 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:32.578812 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:32.579573 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:32.580050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:32.710948 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:32.718521 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-599c378d-3623-4cfe-ab2d-26412511d3a7 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.152018 May 27 03:31:32.719077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 432/848] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:32 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:33.734948 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:33.735542 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:33.742003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:33.742443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:33.743459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:33.743907 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:33.871548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:33.878939 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1aa7a41a-5fbb-4e2c-aa41-e509ca838eb1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.147865 May 27 03:31:33.879497 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 417/849] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:33 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:34.894842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:34.895470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:34.901957 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:34.902408 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:34.903165 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:34.903606 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:35.032248 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:35.039733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b92a3886-6ed7-4c64-8d21-684e14fdd599 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.148742 May 27 03:31:35.040327 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 433/850] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:34 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:36.056580 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:36.057183 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:36.064603 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:36.065046 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:36.065800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:36.066230 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:36.196845 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:36.204280 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e34863c4-331a-4380-b5df-0d147a74308b tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.151483 May 27 03:31:36.204847 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 418/851] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:36 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:36.334436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-161a4004-3c53-432a-8936-056d96dc971d req-e5cea7dc-bfd3-44a2-b7e8-20da53edf290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594cf2db-0111-498c-aa48-6e11dbd811d2", "name": "network-vif-plugged", "status": "completed", "tag": "15a5d120-c2cb-4d46-a227-596e6c129738"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:36.343358 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-161a4004-3c53-432a-8936-056d96dc971d req-e5cea7dc-bfd3-44a2-b7e8-20da53edf290 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:36.344313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-161a4004-3c53-432a-8936-056d96dc971d req-e5cea7dc-bfd3-44a2-b7e8-20da53edf290 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:36.355655 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-161a4004-3c53-432a-8936-056d96dc971d req-e5cea7dc-bfd3-44a2-b7e8-20da53edf290 service nova] Creating event network-vif-plugged:15a5d120-c2cb-4d46-a227-596e6c129738 for instance 594cf2db-0111-498c-aa48-6e11dbd811d2 on hv-cinder-82880 May 27 03:31:36.361014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-161a4004-3c53-432a-8936-056d96dc971d req-e5cea7dc-bfd3-44a2-b7e8-20da53edf290 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 May 27 03:31:36.361596 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 434/852] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:37.221456 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:37.221983 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:37.228256 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:37.228693 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:37.229435 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:37.229860 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:37.374087 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:37.382363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3129d61d-4098-4ba2-b386-c65ac5c5f15f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.165250 May 27 03:31:37.383070 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 419/853] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:37 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:31:38.399566 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:38.400303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:38.407793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:38.408271 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:38.409042 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:38.409481 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:38.555220 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:38.564499 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7bf9dad4-6b22-4ddb-9fc0-523faa966885 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1265 microversion: 2.1 time: 0.168731 May 27 03:31:38.565093 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 435/854] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:38 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:39.581104 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:39.581764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:39.588969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:39.589426 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:39.590454 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:39.590793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:39.731789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:39.739659 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-eaa98215-874e-4784-b36a-ed5605cff3b8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1452 microversion: 2.1 time: 0.162335 May 27 03:31:39.740261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 420/855] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:39 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:39.755534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:39.756261 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:39.762739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:39.763245 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:39.764017 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:39.764467 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:39.910076 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:39.917784 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-507ba20a-0d28-491c-995e-0f25bdfd6b46 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1452 microversion: 2.1 time: 0.166203 May 27 03:31:39.918348 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 436/856] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:39 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:41.854107 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-1d6d9b96-31c2-4c1a-ad9e-8fecacdfa0fe req-3169a6ad-cdb0-466f-8d1b-f6f180a27237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594cf2db-0111-498c-aa48-6e11dbd811d2", "tag": "15a5d120-c2cb-4d46-a227-596e6c129738"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:41.862181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-1d6d9b96-31c2-4c1a-ad9e-8fecacdfa0fe req-3169a6ad-cdb0-466f-8d1b-f6f180a27237 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:41.862700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-1d6d9b96-31c2-4c1a-ad9e-8fecacdfa0fe req-3169a6ad-cdb0-466f-8d1b-f6f180a27237 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:41.873499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-1d6d9b96-31c2-4c1a-ad9e-8fecacdfa0fe req-3169a6ad-cdb0-466f-8d1b-f6f180a27237 service nova] Creating event network-changed:15a5d120-c2cb-4d46-a227-596e6c129738 for instance 594cf2db-0111-498c-aa48-6e11dbd811d2 on hv-cinder-82880 May 27 03:31:41.878916 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-1d6d9b96-31c2-4c1a-ad9e-8fecacdfa0fe req-3169a6ad-cdb0-466f-8d1b-f6f180a27237 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150620 May 27 03:31:41.879806 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 421/857] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:50.807029 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8dfa0813-91ac-4331-bfd3-b57098e97780 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:50.807578 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8dfa0813-91ac-4331-bfd3-b57098e97780 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:50.810230 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=29 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:50.811430 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=69 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:50.823925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8dfa0813-91ac-4331-bfd3-b57098e97780 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:50.824375 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8dfa0813-91ac-4331-bfd3-b57098e97780 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:50.825393 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8dfa0813-91ac-4331-bfd3-b57098e97780 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:50.826057 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8dfa0813-91ac-4331-bfd3-b57098e97780 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:50.855689 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8dfa0813-91ac-4331-bfd3-b57098e97780 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/ips" status: 200 len: 150 microversion: 2.1 time: 0.052448 May 27 03:31:50.856474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 437/858] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:31:50 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:54.541599 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=19 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:54.542332 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=71 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:54.546381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-c605a1c6-5b53-4fc9-af00-b0dcef976a91 req-cd657e99-e859-4aee-8727-54d26125edf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c46fbddd-5f15-41b9-aaab-7fe260aa7bcd", "tag": "71e11d00-d642-48e1-acfd-a532d0199408"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:54.548145 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:54.548732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:54.556381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c605a1c6-5b53-4fc9-af00-b0dcef976a91 req-cd657e99-e859-4aee-8727-54d26125edf8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:54.556574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:54.556867 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:54.556978 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c605a1c6-5b53-4fc9-af00-b0dcef976a91 req-cd657e99-e859-4aee-8727-54d26125edf8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:54.557634 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:54.558068 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:54.569538 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-c605a1c6-5b53-4fc9-af00-b0dcef976a91 req-cd657e99-e859-4aee-8727-54d26125edf8 service nova] Creating event network-changed:71e11d00-d642-48e1-acfd-a532d0199408 for instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd on hv-cinder-82880 May 27 03:31:54.575320 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-c605a1c6-5b53-4fc9-af00-b0dcef976a91 req-cd657e99-e859-4aee-8727-54d26125edf8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033749 May 27 03:31:54.576768 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 438/859] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:54.585050 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:31:54.674343 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-db193c77-c137-4314-8290-6256afa096a9 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 204 len: 0 microversion: 2.1 time: 0.134535 May 27 03:31:54.675109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 422/860] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:31:54 2022] DELETE /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:31:54.684791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:54.686417 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:54.693737 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:54.694455 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:54.695380 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:54.696103 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:54.837629 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:54.846129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3eb71615-73ac-49c0-af1d-068332683e22 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.166453 May 27 03:31:54.846703 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 439/861] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:54 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:55.347663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1ccc4da7-73c7-4656-bdcf-8fd7b0362238 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:55.348864 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1ccc4da7-73c7-4656-bdcf-8fd7b0362238 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:55.355087 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1ccc4da7-73c7-4656-bdcf-8fd7b0362238 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:55.355532 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1ccc4da7-73c7-4656-bdcf-8fd7b0362238 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:55.358886 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1ccc4da7-73c7-4656-bdcf-8fd7b0362238 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:55.359329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1ccc4da7-73c7-4656-bdcf-8fd7b0362238 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:55.864736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:55.865347 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:55.872622 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:55.873075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:55.874526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:55.874966 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:56.003047 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1ccc4da7-73c7-4656-bdcf-8fd7b0362238 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659556 May 27 03:31:56.003732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 423/862] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:31:55 2022] POST /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments => generated 194 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:56.016197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:56.024032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6f5dc679-fe22-49f5-95b5-0a9acdd219b8 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1567 microversion: 2.1 time: 0.163290 May 27 03:31:56.024601 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 440/863] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:55 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:56.895184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-b5fd7f88-16ff-4f25-90cd-576d0ffc6801 req-56d53f2c-0547-4172-a71d-1539e89cf943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c46fbddd-5f15-41b9-aaab-7fe260aa7bcd", "name": "network-vif-deleted", "tag": "71e11d00-d642-48e1-acfd-a532d0199408"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:56.904110 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-b5fd7f88-16ff-4f25-90cd-576d0ffc6801 req-56d53f2c-0547-4172-a71d-1539e89cf943 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:56.904571 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-b5fd7f88-16ff-4f25-90cd-576d0ffc6801 req-56d53f2c-0547-4172-a71d-1539e89cf943 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:56.915434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-b5fd7f88-16ff-4f25-90cd-576d0ffc6801 req-56d53f2c-0547-4172-a71d-1539e89cf943 service nova] Creating event network-vif-deleted:71e11d00-d642-48e1-acfd-a532d0199408 for instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd on hv-cinder-82880 May 27 03:31:56.921385 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-b5fd7f88-16ff-4f25-90cd-576d0ffc6801 req-56d53f2c-0547-4172-a71d-1539e89cf943 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030509 May 27 03:31:56.922219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 424/864] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:57.042154 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:57.042733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:57.050942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:57.051541 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:57.052481 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:57.052990 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:57.121143 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcabfe4f1a6b41049ca2bd37d31759aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d73ce3d68ac4f6e99f9a3b194cde320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:57.129324 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9ede56af-416e-495d-9bab-e9d8204c54c5 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 200 len: 1219 microversion: 2.1 time: 0.091640 May 27 03:31:57.130292 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 441/865] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:57 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:58.148007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:58.149602 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] [instance: c46fbddd-5f15-41b9-aaab-7fe260aa7bcd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:58.156937 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:58.157370 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:58.158307 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:58.158926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:58.175086 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] HTTP exception thrown: Instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd could not be found. May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Request method failure captured: May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd HTTP/1.1 May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikETS253I3P3VtfaJgreD9DIflUtJfANLpT8WhQqY8o671gcl6r_xP8CqSzvZP4mcbczr9JgHwlrwCUERsqKCXVUyWWcKN5XIM6tFFwTFPggaFpTcIqqqGeji2QD_PyLHgV_KpUtu7DeZWZTwuLQcs7PZP40rKBl8ojQAZ-YBaHJOzS8 May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 1d73ce3d68ac4f6e99f9a3b194cde320 May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-TestShelveInstance-1611196707 May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:31:58.176776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1d73ce3d68ac4f6e99f9a3b194cde320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1d73ce3d68ac4f6e99f9a3b194cde320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1d73ce3d68ac4f6e99f9a3b194cde320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1d73ce3d68ac4f6e99f9a3b194cde320"}]}] May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-TestShelveInstance-1611196707 May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 1d73ce3d68ac4f6e99f9a3b194cde320 May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-TestShelveInstance-1611196707 May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-TestShelveInstance-1611196707-project May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: fcabfe4f1a6b41049ca2bd37d31759aa May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-TestShelveInstance-1611196707-project May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd could not be found. May 27 03:31:58.178418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'c46fbddd-5f15-41b9-aaab-7fe260aa7bcd'} May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd could not be found. May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:58.179338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd could not be found. May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd could not be found. May 27 03:31:58.181009 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:31:58.183051 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Returning 404 to user: Instance c46fbddd-5f15-41b9-aaab-7fe260aa7bcd could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:58.183918 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-da0df450-6882-4fe4-ac32-8d03b5b6b708 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd" status: 404 len: 111 microversion: 2.1 time: 0.040972 May 27 03:31:58.188532 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 425/866] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:31:58 2022] GET /compute/v2.1/servers/c46fbddd-5f15-41b9-aaab-7fe260aa7bcd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:31:58.251737 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-18e66800-b30a-4257-9631-3e0f7ce8b1b9 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: .version_select at 0x7f40c0caf0d0>, body: {"keypair": {"name": "tempest-keypair-54873640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9gxE3Y4DfOiM+tIM6SNXwGJOgaa78gWv9rCDdsVzJn2CJOF6xcF2vZlb6n4eCEZP5R4LyIPa1bL47Sk5+AeE62PzpBuMBElZyLeug/Q/TFZiIr1cY/xlVwCnElWKO4wA=="}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:58.266650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-18e66800-b30a-4257-9631-3e0f7ce8b1b9 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:31:58.271533 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-18e66800-b30a-4257-9631-3e0f7ce8b1b9 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:31:58.303399 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-18e66800-b30a-4257-9631-3e0f7ce8b1b9 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.055907 May 27 03:31:58.309232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 442/867] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:31:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:58.380526 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-59b8448a-a9be-4a40-bca0-d8400496a323 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] Calling method '.version_select at 0x7f40c035d160>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:58.411981 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-59b8448a-a9be-4a40-bca0-d8400496a323 tempest-TestShelveInstance-1611196707 tempest-TestShelveInstance-1611196707-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-446497868" status: 202 len: 0 microversion: 2.1 time: 0.036161 May 27 03:31:58.413485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 426/868] 10.222.0.62 () {58 vars in 1250 bytes} [Fri May 27 03:31:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-446497868 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:31:59.917575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-655466752", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fca8f91-27a5-4216-bd00-e734abe0021c"}], "security_groups": [{"name": "tempest-securitygroup--132047630"}], "key_name": "tempest-keypair-54873640", "user_data": "}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:00.054627 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] validate_networks() for [('5fca8f91-27a5-4216-bd00-e734abe0021c', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:32:00.557940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:32:00.558362 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:32:00.559065 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:32:00.559475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:32:00.559916 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:32:00.570109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:00.570566 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:00.571359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:00.571796 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:00.589856 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:32:00.594023 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:32:00.605160 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:32:00.607436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:32:00.668475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-cd3554ca-c6f7-44e8-a9ed-ed84bc256885 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.755432 May 27 03:32:00.669019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 443/869] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:31:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:32:00.680484 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-542a4c6e-209a-40d1-a51e-3ec25284eadd tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:00.681829 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-542a4c6e-209a-40d1-a51e-3ec25284eadd tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:00.769141 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-542a4c6e-209a-40d1-a51e-3ec25284eadd tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:00.779027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-542a4c6e-209a-40d1-a51e-3ec25284eadd tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1239 microversion: 2.1 time: 0.103161 May 27 03:32:00.780481 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 427/870] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:00 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1239 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:32:01.797505 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:01.798667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:01.807379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:01.808117 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:01.809091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:01.811691 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:01.994954 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:02.007701 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-247db49b-a201-4f78-adc8-b419d345f9aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1299 microversion: 2.1 time: 0.214791 May 27 03:32:02.017962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 444/871] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:01 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1299 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:03.026538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:03.028554 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:03.038314 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:03.038765 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:03.039532 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:03.039994 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:03.284667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:03.296374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-23e59a78-66e2-4f47-bcc4-c11969f6eb8d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1364 microversion: 2.1 time: 0.274353 May 27 03:32:03.296958 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 428/872] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:03 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:03.758047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-dc115c7c-83ff-4b64-a08d-e0d02b076052 req-97881819-2bd6-4d25-9d32-aff6d18cc91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b123a0ef-15b7-4266-9c68-59a1515077b2", "tag": "d64fc780-c20b-471e-aff8-575978e954c2"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:03.771717 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-dc115c7c-83ff-4b64-a08d-e0d02b076052 req-97881819-2bd6-4d25-9d32-aff6d18cc91f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:03.772280 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-dc115c7c-83ff-4b64-a08d-e0d02b076052 req-97881819-2bd6-4d25-9d32-aff6d18cc91f service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:03.797548 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-dc115c7c-83ff-4b64-a08d-e0d02b076052 req-97881819-2bd6-4d25-9d32-aff6d18cc91f service nova] Creating event network-changed:d64fc780-c20b-471e-aff8-575978e954c2 for instance b123a0ef-15b7-4266-9c68-59a1515077b2 on hv-cinder-82880 May 27 03:32:03.804482 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-dc115c7c-83ff-4b64-a08d-e0d02b076052 req-97881819-2bd6-4d25-9d32-aff6d18cc91f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050715 May 27 03:32:03.805858 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 445/873] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:04.314375 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:04.315585 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:04.322254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:04.322695 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:04.323728 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:04.324256 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:04.589402 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:04.597789 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-73e632eb-6612-4940-a1c2-3e4211390b36 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1364 microversion: 2.1 time: 0.288008 May 27 03:32:04.599022 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 429/874] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:04 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:05.615523 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:05.616777 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:05.645026 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:05.645661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:05.646267 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:05.646691 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:05.830897 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:05.839357 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-63abd916-fe62-480c-91d5-7101a8994e2c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1364 microversion: 2.1 time: 0.228101 May 27 03:32:05.840169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 446/875] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:05 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:06.856741 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:06.857342 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:06.865568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:06.866024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:06.866808 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:06.867249 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:07.000966 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:07.008387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-333f4041-94a6-40e5-b4f0-121a4507e202 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1364 microversion: 2.1 time: 0.155804 May 27 03:32:07.008953 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 430/876] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:06 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:08.025419 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:08.026050 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:08.032768 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:08.033215 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:08.033972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:08.034408 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:08.159297 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:08.166688 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2f19c235-1f02-4ee2-93df-a6fba4dd6f37 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1364 microversion: 2.1 time: 0.145232 May 27 03:32:08.167260 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 447/877] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:08 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:09.184180 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:09.184754 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:09.191965 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:09.192297 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:09.193079 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:09.193515 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:09.325607 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:09.333651 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5dfe74e0-fb75-4b2a-a1cc-efcb371ec4d0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1364 microversion: 2.1 time: 0.153476 May 27 03:32:09.343177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 431/878] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:09 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:32:09.441308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-0f237f17-0fc1-4161-b0c6-2b147dbf7a25 req-9eadb269-d153-49ad-8fd2-f98014815551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b123a0ef-15b7-4266-9c68-59a1515077b2", "name": "network-vif-plugged", "status": "completed", "tag": "d64fc780-c20b-471e-aff8-575978e954c2"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:09.449833 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-0f237f17-0fc1-4161-b0c6-2b147dbf7a25 req-9eadb269-d153-49ad-8fd2-f98014815551 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:09.450276 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-0f237f17-0fc1-4161-b0c6-2b147dbf7a25 req-9eadb269-d153-49ad-8fd2-f98014815551 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:09.462290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-0f237f17-0fc1-4161-b0c6-2b147dbf7a25 req-9eadb269-d153-49ad-8fd2-f98014815551 service nova] Creating event network-vif-plugged:d64fc780-c20b-471e-aff8-575978e954c2 for instance b123a0ef-15b7-4266-9c68-59a1515077b2 on hv-cinder-82880 May 27 03:32:09.467194 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-0f237f17-0fc1-4161-b0c6-2b147dbf7a25 req-9eadb269-d153-49ad-8fd2-f98014815551 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030366 May 27 03:32:09.467800 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 448/879] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:10.350876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:10.351490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:10.358015 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:10.358464 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:10.359224 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:10.360325 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:10.489497 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:10.497040 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-eda1f7ff-41f5-4d73-af37-f905cece2914 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1364 microversion: 2.1 time: 0.150067 May 27 03:32:10.497601 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 432/880] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:10 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:11.511681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:11.512390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=10 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:11.516845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:11.517554 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:11.524661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:11.525110 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:11.525870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:11.526308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:11.655836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:11.663830 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-dc6c29f5-4abe-49b5-b0e1-6dc3dc577e7f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1554 microversion: 2.1 time: 0.153606 May 27 03:32:11.664408 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 449/881] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:11 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:11.680359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-cfdf1b2d-bfa3-4277-a710-49a4d8ed06eb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:11.680847 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-cfdf1b2d-bfa3-4277-a710-49a4d8ed06eb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:11.682726 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:11.689077 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cfdf1b2d-bfa3-4277-a710-49a4d8ed06eb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:11.689518 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cfdf1b2d-bfa3-4277-a710-49a4d8ed06eb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:11.690264 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cfdf1b2d-bfa3-4277-a710-49a4d8ed06eb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:11.690691 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-cfdf1b2d-bfa3-4277-a710-49a4d8ed06eb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:11.765890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-cfdf1b2d-bfa3-4277-a710-49a4d8ed06eb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089212 May 27 03:32:11.766459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 433/882] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:32:11 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:12.907597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-c76e3aa2-f082-4f33-92d5-4bcfc281ce10 req-885ac66c-2dd9-4772-93e1-b80c2b7b66f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b123a0ef-15b7-4266-9c68-59a1515077b2", "tag": "d64fc780-c20b-471e-aff8-575978e954c2"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:12.916111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c76e3aa2-f082-4f33-92d5-4bcfc281ce10 req-885ac66c-2dd9-4772-93e1-b80c2b7b66f6 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:12.916550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-c76e3aa2-f082-4f33-92d5-4bcfc281ce10 req-885ac66c-2dd9-4772-93e1-b80c2b7b66f6 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:12.928027 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-c76e3aa2-f082-4f33-92d5-4bcfc281ce10 req-885ac66c-2dd9-4772-93e1-b80c2b7b66f6 service nova] Creating event network-changed:d64fc780-c20b-471e-aff8-575978e954c2 for instance b123a0ef-15b7-4266-9c68-59a1515077b2 on hv-cinder-82880 May 27 03:32:12.932919 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-c76e3aa2-f082-4f33-92d5-4bcfc281ce10 req-885ac66c-2dd9-4772-93e1-b80c2b7b66f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028963 May 27 03:32:12.933518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 450/883] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:22.824590 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:22.825398 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:22.829586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-345980897", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:22.881137 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] validate_networks() for None {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:32:23.155445 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:32:23.155916 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:32:23.156384 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:32:23.156783 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:32:23.157192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:32:23.166794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:23.167188 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:23.167994 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:23.168425 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:23.184865 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Getting quotas for project 3c0d3f3daacc41ac8d7f458b7e3ff067. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:32:23.188742 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Getting quotas for user 6603f7ed648e4d4b9d4ae55acb4fe1e3 and project 3c0d3f3daacc41ac8d7f458b7e3ff067. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:32:23.200237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:32:23.202411 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:32:23.246252 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-06c745c9-bb11-487b-8f1d-5d5cee6df491 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.422907 May 27 03:32:23.246898 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 434/884] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:32:23.255616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:23.256428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=56 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:23.260726 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-5173d3a7-74e3-4c13-bf05-0ea318abf519 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:23.261566 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-5173d3a7-74e3-4c13-bf05-0ea318abf519 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:23.315589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-5173d3a7-74e3-4c13-bf05-0ea318abf519 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:23.322927 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-5173d3a7-74e3-4c13-bf05-0ea318abf519 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1214 microversion: 2.1 time: 0.069418 May 27 03:32:23.323480 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 451/885] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:23 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:24.340113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:24.340748 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:24.346835 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:24.347277 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:24.348077 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:24.348510 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:24.409341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:24.416822 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0e69f292-fae5-441c-88b6-e06e144d8686 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1266 microversion: 2.1 time: 0.081100 May 27 03:32:24.417376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 435/886] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:24 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:25.433111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:25.433645 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:25.441186 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:25.441630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:25.442382 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:25.442809 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:25.579668 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:25.588577 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7e6bf3c4-7342-4ed0-bca0-0058e09b7fd8 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1314 microversion: 2.1 time: 0.159395 May 27 03:32:25.589146 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 452/887] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:25 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:25.938731 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-7294de60-6bc7-4235-a8a5-e5e481ccd3d4 req-1bd89c1e-0eb2-434e-83cf-7b6ddcdd99b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cd4801-afa7-4646-99ad-90a1fa39ccbd", "tag": "adeea0e6-d981-4b59-afd5-9623c12e314b"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:25.950111 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-7294de60-6bc7-4235-a8a5-e5e481ccd3d4 req-1bd89c1e-0eb2-434e-83cf-7b6ddcdd99b7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:25.950574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-7294de60-6bc7-4235-a8a5-e5e481ccd3d4 req-1bd89c1e-0eb2-434e-83cf-7b6ddcdd99b7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:25.965788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-7294de60-6bc7-4235-a8a5-e5e481ccd3d4 req-1bd89c1e-0eb2-434e-83cf-7b6ddcdd99b7 service nova] Creating event network-changed:adeea0e6-d981-4b59-afd5-9623c12e314b for instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd on hv-cinder-82880 May 27 03:32:25.970784 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-7294de60-6bc7-4235-a8a5-e5e481ccd3d4 req-1bd89c1e-0eb2-434e-83cf-7b6ddcdd99b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043137 May 27 03:32:25.971453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 436/888] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:26.606289 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:26.606910 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:26.614007 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:26.614451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:26.615203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:26.615640 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:26.741680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:26.749060 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bcc6de50-4843-493d-a071-0d873daf29eb tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1314 microversion: 2.1 time: 0.146662 May 27 03:32:26.749626 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 453/889] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:26 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:27.766565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:27.767261 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:27.773507 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:27.773960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:27.774719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:27.775157 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:27.907556 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:27.915026 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9ec4c3de-f493-4a17-aba9-66e0baad4139 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1314 microversion: 2.1 time: 0.153143 May 27 03:32:27.915667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 437/890] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:27 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:28.931646 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:28.932277 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:28.938354 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:28.938797 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:28.939544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:28.940015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:29.070664 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:29.078396 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f8004576-f383-476f-b30c-9f576097b431 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1314 microversion: 2.1 time: 0.150739 May 27 03:32:29.078951 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 454/891] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:28 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:30.095765 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:30.096393 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:30.103317 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:30.103759 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:30.104538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:30.104968 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:30.229825 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:30.237203 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d04aca68-ac55-43e1-96c6-f6e0aac2751c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1314 microversion: 2.1 time: 0.145307 May 27 03:32:30.237756 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 438/892] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:30 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:31.254156 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:31.254740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:31.261162 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:31.261607 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:31.262364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:31.262797 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:31.387260 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:31.394786 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-57c00f6d-4d5e-42bc-8fb3-46f50354998c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1314 microversion: 2.1 time: 0.144685 May 27 03:32:31.395853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 455/893] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:31 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:31.563544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-8a558036-4d8b-4a57-9064-e5f38ef06164 req-139cfdc7-22a1-4029-9cef-2d9be1f2db7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cd4801-afa7-4646-99ad-90a1fa39ccbd", "name": "network-vif-plugged", "status": "completed", "tag": "adeea0e6-d981-4b59-afd5-9623c12e314b"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:31.572267 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8a558036-4d8b-4a57-9064-e5f38ef06164 req-139cfdc7-22a1-4029-9cef-2d9be1f2db7c service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:31.572711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8a558036-4d8b-4a57-9064-e5f38ef06164 req-139cfdc7-22a1-4029-9cef-2d9be1f2db7c service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:31.589815 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-8a558036-4d8b-4a57-9064-e5f38ef06164 req-139cfdc7-22a1-4029-9cef-2d9be1f2db7c service nova] Creating event network-vif-plugged:adeea0e6-d981-4b59-afd5-9623c12e314b for instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd on hv-cinder-82880 May 27 03:32:31.594974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-8a558036-4d8b-4a57-9064-e5f38ef06164 req-139cfdc7-22a1-4029-9cef-2d9be1f2db7c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035207 May 27 03:32:31.596316 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 439/894] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:32.411771 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:32.412404 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:32.418872 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:32.419319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:32.420104 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:32.420544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:32.548054 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:32.556069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bbffff58-0cd6-4ec5-a362-b243344a6892 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1314 microversion: 2.1 time: 0.148105 May 27 03:32:32.556636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 456/895] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:32 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:33.573990 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:33.574718 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:33.577341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:33.577864 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:33.586503 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.587136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:33.587989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.588480 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:33.716371 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:33.723845 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c507d690-d2d4-4843-9ca0-0ce6645ea42c tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1464 microversion: 2.1 time: 0.154127 May 27 03:32:33.724415 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 440/896] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:33 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:33.762953 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:33.763572 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:33.765535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:33.771356 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.771793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:33.772570 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.773002 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:33.797391 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:32:33.875015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2fe4202b-5c25-49ba-8931-d5da010fbf53 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "DELETE /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 204 len: 0 microversion: 2.1 time: 0.115477 May 27 03:32:33.875923 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 457/897] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:32:33 2022] DELETE /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:32:33.886031 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:33.886639 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:33.892648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.893103 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:33.893862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.894299 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:34.020779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:34.028148 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2a25ae3f-fb32-428e-8390-acc85656cc5e tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1470 microversion: 2.1 time: 0.146588 May 27 03:32:34.028707 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 441/898] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:33 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:32:35.045302 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:35.045998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:35.052516 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:35.052961 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:35.054328 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:35.054759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:35.181681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:35.189121 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-85841438-5bf2-4439-a770-dbd14d22f42a tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1470 microversion: 2.1 time: 0.148014 May 27 03:32:35.189622 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 458/899] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:35 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:36.177272 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-a63abd4e-d270-4627-bdc7-7bf2dfbcd9c2 req-b63dc078-bd33-4918-b683-238615e7c500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cd4801-afa7-4646-99ad-90a1fa39ccbd", "name": "network-vif-deleted", "tag": "adeea0e6-d981-4b59-afd5-9623c12e314b"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:36.186306 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-a63abd4e-d270-4627-bdc7-7bf2dfbcd9c2 req-b63dc078-bd33-4918-b683-238615e7c500 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:36.186747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-a63abd4e-d270-4627-bdc7-7bf2dfbcd9c2 req-b63dc078-bd33-4918-b683-238615e7c500 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:36.199021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-a63abd4e-d270-4627-bdc7-7bf2dfbcd9c2 req-b63dc078-bd33-4918-b683-238615e7c500 service nova] Creating event network-vif-deleted:adeea0e6-d981-4b59-afd5-9623c12e314b for instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd on hv-cinder-82880 May 27 03:32:36.204225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-a63abd4e-d270-4627-bdc7-7bf2dfbcd9c2 req-b63dc078-bd33-4918-b683-238615e7c500 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030785 May 27 03:32:36.205374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 442/900] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:36.206427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:36.207089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:36.214887 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:36.215337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:36.216495 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:36.217265 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:36.290483 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6603f7ed648e4d4b9d4ae55acb4fe1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0d3f3daacc41ac8d7f458b7e3ff067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:36.298604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f96f6330-aa97-4461-8600-1e747fac1d08 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 200 len: 1299 microversion: 2.1 time: 0.095915 May 27 03:32:36.299178 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 459/901] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:36 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:32:37.316485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:37.317136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] [instance: 93cd4801-afa7-4646-99ad-90a1fa39ccbd] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:37.324175 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:37.324623 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:37.325376 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:37.325807 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:37.339467 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] HTTP exception thrown: Instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd could not be found. May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Request method failure captured: May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd HTTP/1.1 May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEZFR2BaVEE8q3cm5Z6MlXuITRHvJKVeOUEH8glYJDEEGWPaFdTCa5q761Kc48n4oK21CLtnnj2ScP9q1Pa5u1icvnHQsg6ycawY894fNGmTnP3eGkKC4c6g0NWTjRgw29nfjQXLDbFFp88JOEb2obsWh96CQqYkQONh-GihiEq8u_4 May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 3c0d3f3daacc41ac8d7f458b7e3ff067 May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesNegativeTest-2081253501 May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:32:37.341113 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3c0d3f3daacc41ac8d7f458b7e3ff067"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c0d3f3daacc41ac8d7f458b7e3ff067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3c0d3f3daacc41ac8d7f458b7e3ff067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c0d3f3daacc41ac8d7f458b7e3ff067"}]}] May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesNegativeTest-2081253501 May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 3c0d3f3daacc41ac8d7f458b7e3ff067 May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesNegativeTest-2081253501 May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesNegativeTest-2081253501-project May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 6603f7ed648e4d4b9d4ae55acb4fe1e3 May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesNegativeTest-2081253501-project May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd could not be found. May 27 03:32:37.342820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '93cd4801-afa7-4646-99ad-90a1fa39ccbd'} May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd could not be found. May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:32:37.343997 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd could not be found. May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd could not be found. May 27 03:32:37.345662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:37.347020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] Returning 404 to user: Instance 93cd4801-afa7-4646-99ad-90a1fa39ccbd could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:32:37.347020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9d88b24b-f457-4989-884a-176cef0618c4 tempest-VolumesNegativeTest-2081253501 tempest-VolumesNegativeTest-2081253501-project] 10.222.0.62 "GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd" status: 404 len: 111 microversion: 2.1 time: 0.030910 May 27 03:32:37.347020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 443/902] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:37 2022] GET /compute/v2.1/servers/93cd4801-afa7-4646-99ad-90a1fa39ccbd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:32:49.062526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8e8d11db-e016-41f9-8779-ec1b5a1a86ea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:49.063125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8e8d11db-e016-41f9-8779-ec1b5a1a86ea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:49.071525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:49.076391 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:49.080908 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e8d11db-e016-41f9-8779-ec1b5a1a86ea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.081410 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e8d11db-e016-41f9-8779-ec1b5a1a86ea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.083702 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e8d11db-e016-41f9-8779-ec1b5a1a86ea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.084543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8e8d11db-e016-41f9-8779-ec1b5a1a86ea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.130952 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8e8d11db-e016-41f9-8779-ec1b5a1a86ea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2/ips" status: 200 len: 150 microversion: 2.1 time: 0.074609 May 27 03:32:49.131579 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 460/903] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:32:49 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2/ips => generated 150 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:49.146491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:49.148683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:49.158750 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:49.159505 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=40 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:49.161210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.161723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.171857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.174705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.367537 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Invalid volume: volume 9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae is already attached to instances: 4725f793-67be-47c7-a4c6-07ccb2be4a57 May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: POST /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2/os-volume_attachments HTTP/1.1 May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 74 May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:32:49.379049 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {"volumeAttachment": {"volumeId": "9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae"}} May 27 03:32:49.380899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Invalid volume: volume 9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae is already attached to instances: 4725f793-67be-47c7-a4c6-07ccb2be4a57 May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'server_id': 'b123a0ef-15b7-4266-9c68-59a1515077b2', 'body': {'volumeAttachment': {'volumeId': '9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae'}}} May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae is already attached to instances: 4725f793-67be-47c7-a4c6-07ccb2be4a57 May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:49.381868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae is already attached to instances: 4725f793-67be-47c7-a4c6-07ccb2be4a57 May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:49.385193 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:32:49.387418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:32:49.387418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:32:49.387418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:32:49.387418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae is already attached to instances: 4725f793-67be-47c7-a4c6-07ccb2be4a57 May 27 03:32:49.387418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:49.390219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 400 to user: Invalid volume: volume 9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae is already attached to instances: 4725f793-67be-47c7-a4c6-07ccb2be4a57 {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:32:49.390219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b1e7165e-b7e8-412d-876b-0da1d6cf4dbf tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.250000 May 27 03:32:49.390219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 444/904] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:32:49 2022] POST /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2/os-volume_attachments => generated 174 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:32:49.398644 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:49.399063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:49.407630 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.408103 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.408884 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.409319 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.484038 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:32:49.682103 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7e59890c-0e6d-4619-a834-227db01be42d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 204 len: 0 microversion: 2.1 time: 0.287253 May 27 03:32:49.683077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 461/905] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:32:49 2022] DELETE /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:32:49.691424 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:49.692460 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:49.705537 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.710295 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.711322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:49.711954 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:49.940717 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:49.953210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-68b3674c-5f55-43c6-837c-dc8ee3c2610f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1679 microversion: 2.1 time: 0.265519 May 27 03:32:49.954461 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 445/906] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:49 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:50.975036 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:50.976432 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:50.987364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:50.988127 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:50.989715 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:50.990510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:51.410377 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:51.423662 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b2e0fe82-2e50-4d99-8b62-94b9aab07108 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1679 microversion: 2.1 time: 0.456318 May 27 03:32:51.424226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 462/907] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:50 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1679 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:52.442446 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:52.444211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:52.451925 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:52.453269 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:52.454262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:52.454879 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:52.487908 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-846147ef-8b44-47f8-9242-ed420e1a610a req-6e607f56-e120-4d5b-9cab-d87c94e57549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b123a0ef-15b7-4266-9c68-59a1515077b2", "name": "network-vif-deleted", "tag": "d64fc780-c20b-471e-aff8-575978e954c2"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:52.502094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-846147ef-8b44-47f8-9242-ed420e1a610a req-6e607f56-e120-4d5b-9cab-d87c94e57549 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:52.503075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-846147ef-8b44-47f8-9242-ed420e1a610a req-6e607f56-e120-4d5b-9cab-d87c94e57549 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:52.547788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:52.565138 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-846147ef-8b44-47f8-9242-ed420e1a610a req-6e607f56-e120-4d5b-9cab-d87c94e57549 service nova] Creating event network-vif-deleted:d64fc780-c20b-471e-aff8-575978e954c2 for instance b123a0ef-15b7-4266-9c68-59a1515077b2 on hv-cinder-82880 May 27 03:32:52.571477 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9aa3bea6-03fa-4751-9af6-2e42f5d09bea tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 200 len: 1612 microversion: 2.1 time: 0.122101 May 27 03:32:52.581371 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-846147ef-8b44-47f8-9242-ed420e1a610a req-6e607f56-e120-4d5b-9cab-d87c94e57549 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089146 May 27 03:32:52.581987 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 446/908] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:52 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 1612 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:52.582084 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 463/909] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:53.589033 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:53.590956 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:53.602994 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:53.603792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:53.604885 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:53.605540 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:53.658945 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 HTTP/1.1 May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:32:53.660654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:32:53.662271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'b123a0ef-15b7-4266-9c68-59a1515077b2'} May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:32:53.663184 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:32:53.664700 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:32:53.667529 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:32:53.668685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f9096a0d-c57d-4147-ae51-4d3c11c821aa tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 404 len: 111 microversion: 2.1 time: 0.083542 May 27 03:32:53.669778 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 447/910] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:53 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:32:53.692160 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-af726390-9b17-4756-824d-c01e950ab981 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '.version_select at 0x7f40c102e700>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:53.734155 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-af726390-9b17-4756-824d-c01e950ab981 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54873640" status: 202 len: 0 microversion: 2.1 time: 0.059960 May 27 03:32:53.735444 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 464/911] 10.222.0.62 () {58 vars in 1214 bytes} [Fri May 27 03:32:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54873640 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:32:54.712255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:54.712255 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:54.720666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:54.721330 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:54.722127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:54.722641 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:54.825561 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lazy-loading 'services' on Instance uuid 4725f793-67be-47c7-a4c6-07ccb2be4a57 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:32:54.928309 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a73614ae-de75-477b-8b86-3a6dd141f055 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments/9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae" status: 202 len: 0 microversion: 2.1 time: 0.220112 May 27 03:32:54.929200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 448/912] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:32:54 2022] DELETE /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments/9fd72ac7-7e7d-492e-a2ea-924b2b7b11ae => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:32:54.938843 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-64bab618-2a28-4a27-b3c8-767519a6f6c0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:54.940384 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-64bab618-2a28-4a27-b3c8-767519a6f6c0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:54.953039 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64bab618-2a28-4a27-b3c8-767519a6f6c0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:54.953703 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64bab618-2a28-4a27-b3c8-767519a6f6c0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:54.954600 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64bab618-2a28-4a27-b3c8-767519a6f6c0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:54.955149 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64bab618-2a28-4a27-b3c8-767519a6f6c0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:54.994798 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-64bab618-2a28-4a27-b3c8-767519a6f6c0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060490 May 27 03:32:54.996143 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 465/913] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:32:54 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:56.011181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e45644fa-87b4-427e-a34b-47c02a9de323 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:56.012366 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e45644fa-87b4-427e-a34b-47c02a9de323 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:56.019249 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e45644fa-87b4-427e-a34b-47c02a9de323 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:56.019694 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e45644fa-87b4-427e-a34b-47c02a9de323 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:56.020507 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e45644fa-87b4-427e-a34b-47c02a9de323 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:56.020943 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e45644fa-87b4-427e-a34b-47c02a9de323 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:56.058333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e45644fa-87b4-427e-a34b-47c02a9de323 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052587 May 27 03:32:56.059501 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 449/914] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:32:56 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:57.073311 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-07cb2b8a-f5fd-402a-b36f-7d519759ea91 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:57.074852 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-07cb2b8a-f5fd-402a-b36f-7d519759ea91 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:57.082047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-07cb2b8a-f5fd-402a-b36f-7d519759ea91 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.082567 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-07cb2b8a-f5fd-402a-b36f-7d519759ea91 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.083574 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-07cb2b8a-f5fd-402a-b36f-7d519759ea91 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.084287 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-07cb2b8a-f5fd-402a-b36f-7d519759ea91 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.115316 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-07cb2b8a-f5fd-402a-b36f-7d519759ea91 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046345 May 27 03:32:57.117086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 466/915] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:32:57 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:32:57.179256 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:57.179850 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:57.186725 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.187250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.188109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.188763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.218210 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:32:57.315793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bcee2fcf-d392-4041-b200-c163e59913e6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 204 len: 0 microversion: 2.1 time: 0.139944 May 27 03:32:57.320123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 450/916] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:32:57 2022] DELETE /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:32:57.327202 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:57.327749 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:57.334491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.335335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.335716 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.336347 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.520557 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:57.529429 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-94c1c876-6186-4151-8c27-266da20b36d5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1681 microversion: 2.1 time: 0.207800 May 27 03:32:57.531587 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 467/917] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:57 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:58.549291 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:58.550653 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:58.557506 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:58.558042 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:58.559103 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:58.559761 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:58.718277 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:58.730678 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-25453f13-559b-4559-9712-edd1cb569104 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1681 microversion: 2.1 time: 0.185640 May 27 03:32:58.731351 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 451/918] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:58 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:59.750578 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:59.751201 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:59.758409 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:59.759098 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:59.759880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:59.760474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:59.850866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:59.861925 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3b730e66-7a1a-4c7b-a989-822a526b3c00 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 200 len: 1614 microversion: 2.1 time: 0.117605 May 27 03:32:59.865819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 468/919] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:32:59 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:59.932412 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-627f4d10-c5de-4963-bd32-8dd789f16d68 req-0d250b5b-1c45-4428-99d3-f8c950fbb638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4725f793-67be-47c7-a4c6-07ccb2be4a57", "name": "network-vif-deleted", "tag": "572284c7-6a4b-4975-93f9-dc7f2d18f828"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:59.945189 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-627f4d10-c5de-4963-bd32-8dd789f16d68 req-0d250b5b-1c45-4428-99d3-f8c950fbb638 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:59.947674 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-627f4d10-c5de-4963-bd32-8dd789f16d68 req-0d250b5b-1c45-4428-99d3-f8c950fbb638 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:59.960642 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-627f4d10-c5de-4963-bd32-8dd789f16d68 req-0d250b5b-1c45-4428-99d3-f8c950fbb638 service nova] Creating event network-vif-deleted:572284c7-6a4b-4975-93f9-dc7f2d18f828 for instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 on hv-cinder-82880 May 27 03:32:59.967604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-627f4d10-c5de-4963-bd32-8dd789f16d68 req-0d250b5b-1c45-4428-99d3-f8c950fbb638 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038790 May 27 03:32:59.972731 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 452/920] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:00.878558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:00.879759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:00.886836 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:00.888216 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:00.889153 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:00.889747 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:00.906039 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 HTTP/1.1 May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:33:00.908015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:33:00.909650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '4725f793-67be-47c7-a4c6-07ccb2be4a57'} May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:33:00.910585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:33:00.912102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:33:00.913402 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:33:00.914357 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4942b672-7f0a-48a0-8efe-9a42b9c867a8 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 404 len: 111 microversion: 2.1 time: 0.039488 May 27 03:33:00.915241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 469/921] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:00 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:33:00.924457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5309410d-191b-494f-88b3-d3bfd752bb6f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '.version_select at 0x7f40c02de8b0>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:00.954566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5309410d-191b-494f-88b3-d3bfd752bb6f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483518943" status: 202 len: 0 microversion: 2.1 time: 0.034061 May 27 03:33:00.955371 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 453/922] 10.222.0.62 () {58 vars in 1217 bytes} [Fri May 27 03:33:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483518943 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:33:01.720869 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-00487f83-c01f-423a-a9bd-9c9a00baeaff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: .version_select at 0x7f40c0de55e0>, body: {"keypair": {"name": "tempest-keypair-775770575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTsM9iWiHqnM6oKwtk8Yjorrksl++/QS4WyXi7ehIi1gwhy/M1J1fBQLKlPOnlvEXjWeGhSUkuasYuYRwOoU1wmcHckRknr6IcxGUtftx3393dip0rQCY040py2ajtKrQ=="}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:01.739632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-00487f83-c01f-423a-a9bd-9c9a00baeaff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:33:01.744748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-00487f83-c01f-423a-a9bd-9c9a00baeaff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:33:01.794977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-00487f83-c01f-423a-a9bd-9c9a00baeaff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078234 May 27 03:33:01.801132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 470/923] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:33:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:02.417401 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c6f3d899-1e01-42ad-ae9b-7c7eb9728ff0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Action: 'create', calling method: .version_select at 0x7f40c03a99d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1283411233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSyoQX9AzPL+AyY7fmiU11eCFa31TwdnienVvNXFRKcnUMgj/ZK6uVisQ5sy9XVtGAQCtxBG2zPPSQhC7ijABXvp2/eoOBic7gTwSr9jRMvvYsrFAUSx3chJODLfGx5MA=="}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:02.436181 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-c6f3d899-1e01-42ad-ae9b-7c7eb9728ff0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Getting quotas for project 54f9fd67a8e2485eba03336c3b0b6b4e. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:33:02.440504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-c6f3d899-1e01-42ad-ae9b-7c7eb9728ff0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Getting quotas for user 5220c5f89d8b4841922a592cbd268c4b and project 54f9fd67a8e2485eba03336c3b0b6b4e. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:33:02.465040 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c6f3d899-1e01-42ad-ae9b-7c7eb9728ff0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052038 May 27 03:33:02.465768 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 454/924] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:33:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:02.524585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1647986274", "imageRef": "df524743-205c-4dba-b655-e7a0b322e9bc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1283411233", "networks": [{"uuid": "96fb4a58-7b25-4b09-a351-97db452d91e4"}]}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:02.580346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] validate_networks() for [('96fb4a58-7b25-4b09-a351-97db452d91e4', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:33:03.423756 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:33:03.424259 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:33:03.424736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:33:03.425143 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:33:03.425579 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:33:03.434704 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:03.435151 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:03.435981 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:03.436413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:03.453633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Getting quotas for project 54f9fd67a8e2485eba03336c3b0b6b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:33:03.457761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Getting quotas for user 5220c5f89d8b4841922a592cbd268c4b and project 54f9fd67a8e2485eba03336c3b0b6b4e. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:33:03.469379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:33:03.471680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='df524743-205c-4dba-b655-e7a0b322e9bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:33:03.516721 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6c80cd0f-1249-40a8-b6d3-356d723c03b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996367 May 27 03:33:03.517466 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 471/925] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:33:03.527959 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8fba2e57-ee87-48e8-a7e7-3c28afa85a92 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:03.529046 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8fba2e57-ee87-48e8-a7e7-3c28afa85a92 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:03.586926 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8fba2e57-ee87-48e8-a7e7-3c28afa85a92 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:03.594222 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8fba2e57-ee87-48e8-a7e7-3c28afa85a92 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1259 microversion: 2.1 time: 0.071011 May 27 03:33:03.594794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 455/926] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:03 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:03.859204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-64158653", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fca8f91-27a5-4216-bd00-e734abe0021c"}], "security_groups": [{"name": "tempest-securitygroup--819328289"}], "key_name": "tempest-keypair-775770575", "user_data": "}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:03.961722 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] validate_networks() for [('5fca8f91-27a5-4216-bd00-e734abe0021c', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:33:04.337971 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:33:04.338389 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:33:04.338866 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:33:04.339337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:33:04.339745 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:33:04.349169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:04.349614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:04.350412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:04.350846 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:04.369164 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:33:04.372940 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:33:04.383618 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:33:04.385788 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:33:04.430824 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bf3d9a78-67e8-4300-87ff-d4d659f993cb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.576408 May 27 03:33:04.431468 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 472/927] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:33:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:33:04.454797 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a724b56c-34ed-49c6-8c03-375c968013ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:04.455412 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a724b56c-34ed-49c6-8c03-375c968013ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:04.511596 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-a724b56c-34ed-49c6-8c03-375c968013ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:04.521268 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a724b56c-34ed-49c6-8c03-375c968013ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1239 microversion: 2.1 time: 0.070367 May 27 03:33:04.521829 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 456/928] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:04 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:04.611366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:04.612025 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:04.619065 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:04.619519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:04.620306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:04.621037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:04.701905 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:04.713327 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-84a38391-c4bc-44a8-9c39-d6928e5ef61d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1311 microversion: 2.1 time: 0.106264 May 27 03:33:04.714292 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 473/929] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:04 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:05.538606 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:05.539453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:05.547488 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:05.547967 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:05.548954 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:05.549544 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:05.676779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:05.689018 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3a58fd3a-89dc-4f98-9927-97067cdd5439 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.151386 May 27 03:33:05.690692 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 457/930] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:05 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:05.730729 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:05.731346 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:05.738260 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:05.748955 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:05.750200 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:05.750655 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:05.956532 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:05.967854 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-551ed1d5-cf3f-4186-b9cb-116ef33e200d tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.240995 May 27 03:33:05.968642 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 474/931] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:05 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:06.707564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:06.708209 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:06.715237 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:06.715688 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:06.716655 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:06.717096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:06.781568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:06.789812 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7584ff4c-6f29-4c5f-8668-c0d2d644380d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.085843 May 27 03:33:06.790694 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 458/932] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:06 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:06.985455 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:06.986192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:06.993063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:06.993509 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:06.994277 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:06.994710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:07.135560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:07.143922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-688e95ce-a57c-463e-8d6b-62d902ae7df6 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.162849 May 27 03:33:07.144697 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 475/933] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:06 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:07.807328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:07.808105 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:07.815152 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:07.815859 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:07.816794 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:07.817391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:07.883369 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:07.891735 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-6d8233f5-2999-4a80-92f1-ed675a1391f3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.088360 May 27 03:33:07.892324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 459/934] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:07 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:08.165496 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:08.166132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:08.173409 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.173861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.174636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.175072 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.318872 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:08.327976 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b64e6c0f-6775-4498-a3ec-b7070c07fdef tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.166311 May 27 03:33:08.328689 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 476/935] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:08 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:08.908453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:08.909061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:08.916025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.916478 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.917251 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.919516 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.990108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:08.998121 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3b106b87-3586-4fb1-b93b-978309ce79f6 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.093519 May 27 03:33:08.998890 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 460/936] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:08 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:33:09.344426 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:09.345082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:09.352086 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:09.352621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:09.353500 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:09.354004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:09.491014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:09.499463 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ae01491d-5818-485b-85ae-fff90994a8bc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.158827 May 27 03:33:09.500277 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 477/937] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:09 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:10.014928 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:10.015705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:10.023217 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:10.023685 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:10.024690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:10.025111 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:10.116988 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:10.125415 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-90bf1094-c965-4599-b767-36c5aff2402e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.114720 May 27 03:33:10.126211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 461/938] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:10 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:10.516204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:10.516868 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:10.523748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:10.524225 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:10.524982 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:10.525413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:10.664517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:10.672855 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0c201140-575c-4894-a716-f964aee8683e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.160445 May 27 03:33:10.673631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 478/939] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:10 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:11.142608 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:11.143212 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:11.150042 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:11.150607 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:11.151418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:11.151924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:11.227666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:11.235793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-941e6744-6a97-4466-b5fa-e5593c97a605 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.097119 May 27 03:33:11.236387 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 462/940] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:11 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:11.689462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:11.690148 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:11.696811 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:11.697264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:11.698339 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:11.698842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:11.834740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:11.838550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:11.842995 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-486f4e44-c888-4d4f-9618-d0ae555559b8 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.157370 May 27 03:33:11.843568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 479/941] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:11 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:12.253896 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:12.254485 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:12.261134 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:12.261578 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:12.262348 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:12.262815 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:12.284711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:12.332791 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:12.340388 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-92106822-a8aa-48c4-9cb4-4fbe7016d5ff tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.090473 May 27 03:33:12.340959 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 463/942] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:12 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:33:12.860039 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:12.860663 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:12.868288 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:12.868733 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:12.869523 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:12.869950 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:13.030515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:13.039208 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f022898a-7ba4-4f16-8828-057586f3bcde tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.183231 May 27 03:33:13.040034 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 480/943] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:12 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:13.358340 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:13.358959 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:13.365365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:13.365803 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:13.366552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:13.366976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:13.426927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:13.434219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d86589eb-404a-405b-ad1c-7f46f1f6e403 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1291 microversion: 2.1 time: 0.080326 May 27 03:33:13.434776 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 464/944] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:13 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1291 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:14.057388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:14.059847 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:14.068040 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:14.068582 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:14.069434 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:14.069939 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:14.203921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:14.211488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-bde6b1cb-6ddf-48a3-8e0a-c11f32accdfe tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.158707 May 27 03:33:14.212078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 481/945] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:14 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:14.450782 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:14.451479 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:14.460697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:14.461546 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:14.462604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:14.463043 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:14.516318 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=8 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:14.556564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:14.566752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-71d53014-fad9-4f61-abd9-6bc82dbdc9b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1297 microversion: 2.1 time: 0.120110 May 27 03:33:14.567327 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 465/946] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:14 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:14.855443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-4f438e0a-94bb-431a-aa25-f8e38ea766df req-486bdf52-a606-404d-925c-c911d8798ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626e76e5-4962-45d3-accd-406dfc8dae92", "tag": "6c377781-a67e-4b85-a7a6-00d1694a82dc"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:14.859329 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=4 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:14.862053 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=16 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:14.870788 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-4f438e0a-94bb-431a-aa25-f8e38ea766df req-486bdf52-a606-404d-925c-c911d8798ad0 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:14.871569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-4f438e0a-94bb-431a-aa25-f8e38ea766df req-486bdf52-a606-404d-925c-c911d8798ad0 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:14.885169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-4f438e0a-94bb-431a-aa25-f8e38ea766df req-486bdf52-a606-404d-925c-c911d8798ad0 service nova] Creating event network-changed:6c377781-a67e-4b85-a7a6-00d1694a82dc for instance 626e76e5-4962-45d3-accd-406dfc8dae92 on hv-cinder-82880 May 27 03:33:14.892392 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-4f438e0a-94bb-431a-aa25-f8e38ea766df req-486bdf52-a606-404d-925c-c911d8798ad0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047471 May 27 03:33:14.893556 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 482/947] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:15.230817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:15.231655 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:15.237941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:15.238464 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:15.239353 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:15.240005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:15.532764 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:15.541317 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ca4df9da-5a7d-48de-89d6-667e4a99b609 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.316967 May 27 03:33:15.541968 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 466/948] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:15 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:15.584837 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:15.585534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:15.592563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:15.593019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:15.593776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:15.594207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:15.727281 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:15.736111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2d5fdbed-3348-4d85-9cc9-123418eac552 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1364 microversion: 2.1 time: 0.155419 May 27 03:33:15.736825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 483/949] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:15 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:16.558084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:16.558699 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:16.565723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:16.566177 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:16.566940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:16.567371 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:16.753963 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:16.754564 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:16.758167 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:16.762197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:16.762641 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:16.763449 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:16.763912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:16.898227 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:16.906031 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-054f1208-efaa-4d59-8266-97a376ddcaa1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1364 microversion: 2.1 time: 0.155916 May 27 03:33:16.906695 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 484/950] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:16 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:33:16.915576 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-9a618fd2-1c89-4369-9b2e-79b837b08c89 req-af844404-7152-4491-bb3c-1326414e6b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c99fc1-ceba-4a21-8037-49cc40802c0f", "tag": "7af37490-4b36-4ff1-b478-34c104e7a6d7"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:16.924750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-9a618fd2-1c89-4369-9b2e-79b837b08c89 req-af844404-7152-4491-bb3c-1326414e6b7d service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:16.925192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-9a618fd2-1c89-4369-9b2e-79b837b08c89 req-af844404-7152-4491-bb3c-1326414e6b7d service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:16.937106 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-9a618fd2-1c89-4369-9b2e-79b837b08c89 req-af844404-7152-4491-bb3c-1326414e6b7d service nova] Creating event network-changed:7af37490-4b36-4ff1-b478-34c104e7a6d7 for instance 20c99fc1-ceba-4a21-8037-49cc40802c0f on hv-cinder-82880 May 27 03:33:16.941900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-9a618fd2-1c89-4369-9b2e-79b837b08c89 req-af844404-7152-4491-bb3c-1326414e6b7d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030569 May 27 03:33:16.942488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 485/951] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:17.096108 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:17.103468 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d0f2404a-f1a0-435e-82a0-86048e4e80ab tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.549240 May 27 03:33:17.104073 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 467/952] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:16 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:17.923978 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:17.924681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:17.931020 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:17.931475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:17.932263 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:17.932698 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:18.062672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:18.070059 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4d9cef29-4333-4aed-b737-d6bc9d74c7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1364 microversion: 2.1 time: 0.151398 May 27 03:33:18.070613 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 486/953] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:17 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:18.122146 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:18.122746 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:18.129470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:18.129911 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:18.130660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:18.131088 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:18.337155 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:18.345192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-ffc96fb6-6f46-4464-b865-1730f2d0184a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.226899 May 27 03:33:18.345767 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 468/954] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:18 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:19.086404 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:19.087016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:19.094111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:19.094560 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:19.095320 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:19.095751 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:19.221498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:19.235915 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ce304e95-f70d-4303-83e4-77cad53ffc3e tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1364 microversion: 2.1 time: 0.153265 May 27 03:33:19.236502 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 487/955] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:19 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:19.362999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:19.363606 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:19.366025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:19.371644 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:19.372112 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:19.372880 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:19.373313 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:19.503440 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:19.510924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-12b901bc-6898-4c0e-ad39-0f56ce11bba2 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.152235 May 27 03:33:19.511490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 469/956] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:19 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:19.963668 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-cda34adc-35c1-4d51-961a-c502cc905a6a req-ae7b9fae-0a18-4e97-a8ea-d905ca65f78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626e76e5-4962-45d3-accd-406dfc8dae92", "name": "network-vif-plugged", "status": "completed", "tag": "6c377781-a67e-4b85-a7a6-00d1694a82dc"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:19.974460 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cda34adc-35c1-4d51-961a-c502cc905a6a req-ae7b9fae-0a18-4e97-a8ea-d905ca65f78e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:19.974912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-cda34adc-35c1-4d51-961a-c502cc905a6a req-ae7b9fae-0a18-4e97-a8ea-d905ca65f78e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:19.986294 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-cda34adc-35c1-4d51-961a-c502cc905a6a req-ae7b9fae-0a18-4e97-a8ea-d905ca65f78e service nova] Creating event network-vif-plugged:6c377781-a67e-4b85-a7a6-00d1694a82dc for instance 626e76e5-4962-45d3-accd-406dfc8dae92 on hv-cinder-82880 May 27 03:33:19.990955 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-cda34adc-35c1-4d51-961a-c502cc905a6a req-ae7b9fae-0a18-4e97-a8ea-d905ca65f78e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039115 May 27 03:33:19.991536 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 488/957] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:20.255106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:20.255721 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:20.261805 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:20.262253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:20.263019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:20.263454 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:20.393600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:20.401593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-aa879618-8951-411f-8f63-e837cd443317 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1364 microversion: 2.1 time: 0.150218 May 27 03:33:20.402312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 470/958] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:20 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:20.529929 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:20.530558 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:20.538769 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:20.539217 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:20.540047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:20.540488 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:20.666796 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:20.674171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3bf43213-cfc0-4e64-bf5d-37a0c71ff7e3 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1359 microversion: 2.1 time: 0.149009 May 27 03:33:20.674738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 489/959] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:20 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:21.418696 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:21.419301 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:21.426397 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:21.426844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:21.427600 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:21.428057 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:21.558514 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:21.566883 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-58ddc7ba-651f-45be-a123-f6a94e576013 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1364 microversion: 2.1 time: 0.152017 May 27 03:33:21.567445 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 471/960] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:21 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:21.690710 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:21.691232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:21.697747 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:21.698199 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:21.698967 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:21.699398 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:21.833792 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:21.841977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-05132466-792b-4911-80bf-62a09fd89f14 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1550 microversion: 2.1 time: 0.155091 May 27 03:33:21.842923 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 490/961] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:21 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:21.858868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:21.860229 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:21.866206 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:21.866648 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:21.867404 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:21.867840 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:21.993457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:22.000883 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-8314f020-439f-4fab-befe-d93b722ad13f tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1550 microversion: 2.1 time: 0.145921 May 27 03:33:22.001442 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 472/962] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:21 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:22.007927 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-02d4ac8d-480c-4d48-85ea-0301d65dcb63 req-8e12cd1c-bb02-4d8d-a4ea-f3d76c88d9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c99fc1-ceba-4a21-8037-49cc40802c0f", "name": "network-vif-plugged", "status": "completed", "tag": "7af37490-4b36-4ff1-b478-34c104e7a6d7"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:22.016314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-02d4ac8d-480c-4d48-85ea-0301d65dcb63 req-8e12cd1c-bb02-4d8d-a4ea-f3d76c88d9f2 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:22.016576 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:22.016749 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-02d4ac8d-480c-4d48-85ea-0301d65dcb63 req-8e12cd1c-bb02-4d8d-a4ea-f3d76c88d9f2 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:22.020074 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:22.020960 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Searching by: {'deleted': False, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e'} {{(pid=117609) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 03:33:22.027410 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:22.027568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-02d4ac8d-480c-4d48-85ea-0301d65dcb63 req-8e12cd1c-bb02-4d8d-a4ea-f3d76c88d9f2 service nova] Creating event network-vif-plugged:7af37490-4b36-4ff1-b478-34c104e7a6d7 for instance 20c99fc1-ceba-4a21-8037-49cc40802c0f on hv-cinder-82880 May 27 03:33:22.027873 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:22.028654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:22.029079 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:22.032792 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-02d4ac8d-480c-4d48-85ea-0301d65dcb63 req-8e12cd1c-bb02-4d8d-a4ea-f3d76c88d9f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028434 May 27 03:33:22.033362 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 491/963] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:33:22.117213 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.multi_cell_list [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117609) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 03:33:22.217628 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-42ff2eec-96a4-4152-a634-b6f413971fdb tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204952 May 27 03:33:22.218312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 473/964] 10.222.0.62 () {58 vars in 1124 bytes} [Fri May 27 03:33:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:33:22.229876 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:22.230650 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:22.237021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:22.237545 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:22.238428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:22.238863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:22.365134 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:22.372524 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e407fd03-e3ce-40fb-9f52-fccb83d440af tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1550 microversion: 2.1 time: 0.147165 May 27 03:33:22.373081 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 492/965] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:22 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:22.583842 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:22.584836 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:22.591085 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:22.591533 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:22.592437 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:22.592871 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:22.737905 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:22.745296 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-01905190-b3d8-4114-9b15-3034e29113c5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1364 microversion: 2.1 time: 0.165242 May 27 03:33:22.745859 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 474/966] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:22 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:23.762681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:23.763370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:23.770734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:23.771390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:23.772204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:23.772634 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:23.882896 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a67f1844-d083-456e-a3fe-b46a22117447 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "948f92d6-5de0-48d6-8668-5790a278c83d"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:23.883964 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a67f1844-d083-456e-a3fe-b46a22117447 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:23.890270 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a67f1844-d083-456e-a3fe-b46a22117447 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:23.890740 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a67f1844-d083-456e-a3fe-b46a22117447 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:23.891488 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a67f1844-d083-456e-a3fe-b46a22117447 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:23.891941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a67f1844-d083-456e-a3fe-b46a22117447 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:23.910335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:23.918045 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a66fad79-74c6-4eb8-a289-f20e1da2ec15 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1555 microversion: 2.1 time: 0.159189 May 27 03:33:23.918620 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 493/967] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:23 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:23.934781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-471bbcca-b314-4cce-bc01-272f8505eeeb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:23.935286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-471bbcca-b314-4cce-bc01-272f8505eeeb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:23.942337 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-471bbcca-b314-4cce-bc01-272f8505eeeb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:23.942791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-471bbcca-b314-4cce-bc01-272f8505eeeb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:23.943563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-471bbcca-b314-4cce-bc01-272f8505eeeb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:23.944038 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-471bbcca-b314-4cce-bc01-272f8505eeeb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:24.025820 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-471bbcca-b314-4cce-bc01-272f8505eeeb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094729 May 27 03:33:24.026411 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 494/968] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:33:23 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:33:24.167379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a67f1844-d083-456e-a3fe-b46a22117447 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287950 May 27 03:33:24.168192 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 475/969] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:33:23 2022] POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:33:24.961354 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-72b36839-3120-48af-9fd9-f8b8b93bfbee req-561e02a4-33bd-4aa4-96b8-f484d927220b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c99fc1-ceba-4a21-8037-49cc40802c0f", "tag": "7af37490-4b36-4ff1-b478-34c104e7a6d7"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:24.969626 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-72b36839-3120-48af-9fd9-f8b8b93bfbee req-561e02a4-33bd-4aa4-96b8-f484d927220b service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:24.970154 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-72b36839-3120-48af-9fd9-f8b8b93bfbee req-561e02a4-33bd-4aa4-96b8-f484d927220b service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:24.983129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-72b36839-3120-48af-9fd9-f8b8b93bfbee req-561e02a4-33bd-4aa4-96b8-f484d927220b service nova] Creating event network-changed:7af37490-4b36-4ff1-b478-34c104e7a6d7 for instance 20c99fc1-ceba-4a21-8037-49cc40802c0f on hv-cinder-82880 May 27 03:33:24.988651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-72b36839-3120-48af-9fd9-f8b8b93bfbee req-561e02a4-33bd-4aa4-96b8-f484d927220b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031665 May 27 03:33:24.989525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 495/970] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:32.236338 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-952771741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1096312396", "security_groups": [{"name": "tempest-secgroup-smoke-73264536"}], "block_device_mapping_v2": [{"uuid": "9cae7c80-d37a-488a-a5dc-9015e68c9b00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "561895ec-13c2-4737-9f4c-a28189f41261"}]}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:32.244929 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:32.347736 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.network.neutron [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] validate_networks() for [('561895ec-13c2-4737-9f4c-a28189f41261', None, None, None, None, None)] {{(pid=117609) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:33:32.707478 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Flavor limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:33:32.707953 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Image limits 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:33:32.708423 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Flavor pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:33:32.708826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Image pref 0:0:0 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:33:32.709231 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.virt.hardware [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:33:32.718749 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:32.719194 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:32.720023 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:32.720461 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:32.737195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:33:32.741127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Getting quotas for user 5c8ad338eb7b47c18dcb86f287e28858 and project ffc47aa302dc4c4e94c4bc7227728c40. Resources: {'instances', 'cores', 'ram'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:33:32.796345 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Going to run 1 instances... {{(pid=117609) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:33:32.799007 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9cae7c80-d37a-488a-a5dc-9015e68c9b00',volume_size=None,volume_type=None)] {{(pid=117609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:33:32.921977 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a2226723-92a2-4318-8978-14ccbd8e22d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.689715 May 27 03:33:32.923019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 476/971] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:33:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:33:32.934750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-7f07b9ac-2b2a-4b57-9ef7-bf82d4a575b1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:32.936197 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-7f07b9ac-2b2a-4b57-9ef7-bf82d4a575b1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:32.994069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-7f07b9ac-2b2a-4b57-9ef7-bf82d4a575b1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:33.000621 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-7f07b9ac-2b2a-4b57-9ef7-bf82d4a575b1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1094 microversion: 2.1 time: 0.070765 May 27 03:33:33.001208 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 496/972] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:32 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:34.017227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:34.017832 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:34.024666 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:34.025112 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:34.025866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:34.026300 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:34.087244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:34.094737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-596e2432-f4e3-4b01-bc0b-3bc1e317d833 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1192 microversion: 2.1 time: 0.081869 May 27 03:33:34.095308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 477/973] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:34 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:34.863284 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:34.863952 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:34.870406 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:34.870857 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:34.871618 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:34.872078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:35.048247 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:35.065445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b296a4cf-baa3-4c37-981e-7bd59c2119e0 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1596 microversion: 2.1 time: 0.206428 May 27 03:33:35.066364 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 497/974] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:34 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1596 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:35.113457 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:35.114711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:35.122843 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:35.123556 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:35.124809 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:35.125401 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:35.441644 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:35.450292 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4e0d0a41-52c1-479e-89d1-7d4d54dd4b92 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1276 microversion: 2.1 time: 0.342131 May 27 03:33:35.450871 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 478/975] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:35 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1276 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:35.856292 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-0c32d889-6ad8-46d6-bd69-6ad727073e34 req-f720c1aa-a55c-4f1e-ac9f-e1cd672ea8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd8487d-5eed-4492-b1ce-5a260cc7292f", "tag": "0043daec-332d-4272-9b40-80a037bc94a6"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:35.868080 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-0c32d889-6ad8-46d6-bd69-6ad727073e34 req-f720c1aa-a55c-4f1e-ac9f-e1cd672ea8f7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:35.869401 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-0c32d889-6ad8-46d6-bd69-6ad727073e34 req-f720c1aa-a55c-4f1e-ac9f-e1cd672ea8f7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:35.885530 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-0c32d889-6ad8-46d6-bd69-6ad727073e34 req-f720c1aa-a55c-4f1e-ac9f-e1cd672ea8f7 service nova] Creating event network-changed:0043daec-332d-4272-9b40-80a037bc94a6 for instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f on hv-cinder-82880 May 27 03:33:35.892597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-0c32d889-6ad8-46d6-bd69-6ad727073e34 req-f720c1aa-a55c-4f1e-ac9f-e1cd672ea8f7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038385 May 27 03:33:35.894469 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 498/976] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:33:36.468199 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:36.468980 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:36.475654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:36.476201 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:36.477010 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:36.477509 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:36.481770 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:36.615481 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:36.623391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0771724e-71bf-46d8-b9b5-ef1edc7820c2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.158927 May 27 03:33:36.624110 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 479/977] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:36 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:37.105611 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-d27d3f9d-efc8-47bf-b57c-cb5a3b43a281 req-c91d1b30-5cb7-46af-b5a2-a8a567c5924a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626e76e5-4962-45d3-accd-406dfc8dae92", "tag": "6c377781-a67e-4b85-a7a6-00d1694a82dc"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:37.114809 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-d27d3f9d-efc8-47bf-b57c-cb5a3b43a281 req-c91d1b30-5cb7-46af-b5a2-a8a567c5924a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:37.115680 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-d27d3f9d-efc8-47bf-b57c-cb5a3b43a281 req-c91d1b30-5cb7-46af-b5a2-a8a567c5924a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:37.129451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-d27d3f9d-efc8-47bf-b57c-cb5a3b43a281 req-c91d1b30-5cb7-46af-b5a2-a8a567c5924a service nova] Creating event network-changed:6c377781-a67e-4b85-a7a6-00d1694a82dc for instance 626e76e5-4962-45d3-accd-406dfc8dae92 on hv-cinder-82880 May 27 03:33:37.135656 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-d27d3f9d-efc8-47bf-b57c-cb5a3b43a281 req-c91d1b30-5cb7-46af-b5a2-a8a567c5924a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034685 May 27 03:33:37.137121 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 499/978] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:37.641767 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:37.642690 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:37.656397 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:37.656877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:37.657710 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:37.658141 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:37.977637 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:37.987254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9f66491c-275a-44a3-9f56-c8cbc1819e19 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.350177 May 27 03:33:37.989187 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 480/979] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:37 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:38.083125 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1929362669"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:38.083760 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:38.090379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:38.090845 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:38.091617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:38.092083 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:38.234182 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.network.security_group_api [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Adding security group 1cd3d8bd-6c29-444c-a5b4-2c39179e198a to port 6c377781-a67e-4b85-a7a6-00d1694a82dc May 27 03:33:38.644904 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-680f4108-ad2e-43a1-8291-66893d918291 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/action" status: 202 len: 0 microversion: 2.1 time: 0.565853 May 27 03:33:38.645518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 500/980] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:33:38 2022] POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:33:38.655294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:38.656646 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:38.664344 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:38.665072 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:38.666391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:38.667028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:38.833050 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:38.841429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-39c19a8a-2a0d-4fb0-bd89-49038c5f7d72 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1761 microversion: 2.1 time: 0.191487 May 27 03:33:38.852850 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 481/981] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:38 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1761 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:39.005539 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:39.006181 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:39.012183 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:39.012628 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:39.013389 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:39.013827 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:39.148603 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:39.155200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-731e3199-1e4a-48fd-a6dc-2d964687b3a3 req-c4c1751d-cbab-4e3b-9889-ecabb36e8273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626e76e5-4962-45d3-accd-406dfc8dae92", "tag": "6c377781-a67e-4b85-a7a6-00d1694a82dc"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:39.157091 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-133001e5-5259-41f3-9acc-432030dcc41e tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.156243 May 27 03:33:39.157749 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 501/982] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:38 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:39.164872 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-731e3199-1e4a-48fd-a6dc-2d964687b3a3 req-c4c1751d-cbab-4e3b-9889-ecabb36e8273 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:39.165299 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-731e3199-1e4a-48fd-a6dc-2d964687b3a3 req-c4c1751d-cbab-4e3b-9889-ecabb36e8273 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:39.177554 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-731e3199-1e4a-48fd-a6dc-2d964687b3a3 req-c4c1751d-cbab-4e3b-9889-ecabb36e8273 service nova] Creating event network-changed:6c377781-a67e-4b85-a7a6-00d1694a82dc for instance 626e76e5-4962-45d3-accd-406dfc8dae92 on hv-cinder-82880 May 27 03:33:39.182650 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-731e3199-1e4a-48fd-a6dc-2d964687b3a3 req-c4c1751d-cbab-4e3b-9889-ecabb36e8273 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030884 May 27 03:33:39.183363 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 482/983] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:33:40.173667 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:40.174308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:40.180883 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:40.181328 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:40.182082 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:40.182510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:40.317032 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:40.320603 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=100 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:40.325562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-75cb5be2-254c-4e96-8cfc-94ebddcee5bd tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.155718 May 27 03:33:40.326122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 502/984] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:40 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:41.343404 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:41.344121 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:41.350429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:41.350866 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:41.351609 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:41.352092 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:41.481243 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:41.489096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7d9cb670-cd45-4a08-8d39-1019ba0ec3d2 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.150351 May 27 03:33:41.489649 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 483/985] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:41 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:42.506290 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:42.506806 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:42.513424 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:42.513870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:42.514626 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:42.515055 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:42.642062 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:42.649462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e917aaa5-cfec-436b-a33b-d427d2b95f34 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.147907 May 27 03:33:42.650019 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 503/986] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:42 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:43.666467 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:43.667103 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:43.669492 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:43.670131 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:43.676047 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:43.676486 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:43.677225 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:43.677650 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:43.811527 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:43.819248 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c7a80d82-7da4-482b-b7c6-982d83f91d1f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.156565 May 27 03:33:43.819834 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 484/987] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:43 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:44.835534 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:44.836171 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:44.838069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:44.845199 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:44.845684 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:44.846452 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:44.846889 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:44.980130 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:44.987563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-206d8061-980b-4ccc-ad24-800cce4cf02f tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.155895 May 27 03:33:44.988175 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 504/988] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:44 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:45.933534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-ef4feaf2-62c0-4a8e-bf43-3166c6b3a8ca req-590b02b0-93fe-4529-a156-9126fe689bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd8487d-5eed-4492-b1ce-5a260cc7292f", "name": "network-vif-plugged", "status": "completed", "tag": "0043daec-332d-4272-9b40-80a037bc94a6"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:45.942205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-ef4feaf2-62c0-4a8e-bf43-3166c6b3a8ca req-590b02b0-93fe-4529-a156-9126fe689bd9 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:45.942509 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-ef4feaf2-62c0-4a8e-bf43-3166c6b3a8ca req-590b02b0-93fe-4529-a156-9126fe689bd9 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:45.954640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-ef4feaf2-62c0-4a8e-bf43-3166c6b3a8ca req-590b02b0-93fe-4529-a156-9126fe689bd9 service nova] Creating event network-vif-plugged:0043daec-332d-4272-9b40-80a037bc94a6 for instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f on hv-cinder-82880 May 27 03:33:45.959499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-ef4feaf2-62c0-4a8e-bf43-3166c6b3a8ca req-590b02b0-93fe-4529-a156-9126fe689bd9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029642 May 27 03:33:45.960116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 485/989] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:46.006148 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:46.006793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:46.013043 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:46.013493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:46.014257 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:46.014690 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:46.146620 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:46.154387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-64753073-eb48-46b6-a995-6417f011fabb tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.152768 May 27 03:33:46.155093 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 505/990] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:46 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:33:47.177319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:47.178013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:47.184408 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:47.184864 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:47.185631 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:47.186066 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:47.315660 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:47.323612 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1166dd97-9705-4989-860e-611a865aef4c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1264 microversion: 2.1 time: 0.151063 May 27 03:33:47.324198 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 486/991] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:47 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:48.340799 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:48.341419 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:48.343770 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=45 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:33:48.350265 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:48.350715 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:48.351475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:48.351942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:48.483070 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:48.490793 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-0c2577ff-f317-41b8-9cba-6219048c95e9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1451 microversion: 2.1 time: 0.153845 May 27 03:33:48.491361 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 506/992] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:48 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:48.507039 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:48.507678 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:48.514130 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:48.514579 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:48.515331 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:48.515758 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:48.651045 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:48.658638 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b6d8463c-f3d3-4ee0-a1b6-515fa0f4e17c tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1451 microversion: 2.1 time: 0.155902 May 27 03:33:48.659194 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 487/993] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:33:48 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:50.457647 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-7e922321-6f6d-4e3c-9f49-a85c934047fa req-1505854c-3a32-46f7-a459-e54b542f244a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd8487d-5eed-4492-b1ce-5a260cc7292f", "tag": "0043daec-332d-4272-9b40-80a037bc94a6"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:50.466632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-7e922321-6f6d-4e3c-9f49-a85c934047fa req-1505854c-3a32-46f7-a459-e54b542f244a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:50.467266 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-7e922321-6f6d-4e3c-9f49-a85c934047fa req-1505854c-3a32-46f7-a459-e54b542f244a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:50.478367 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-7e922321-6f6d-4e3c-9f49-a85c934047fa req-1505854c-3a32-46f7-a459-e54b542f244a service nova] Creating event network-changed:0043daec-332d-4272-9b40-80a037bc94a6 for instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f on hv-cinder-82880 May 27 03:33:50.483638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-7e922321-6f6d-4e3c-9f49-a85c934047fa req-1505854c-3a32-46f7-a459-e54b542f244a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030216 May 27 03:33:50.484542 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 507/994] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:01.323534 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1488429c-a79e-4e1b-a34d-c26a868e7562 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:01.324423 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1488429c-a79e-4e1b-a34d-c26a868e7562 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:01.326972 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:01.327842 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=44 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:01.334680 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1488429c-a79e-4e1b-a34d-c26a868e7562 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:01.335152 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1488429c-a79e-4e1b-a34d-c26a868e7562 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:01.336027 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1488429c-a79e-4e1b-a34d-c26a868e7562 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:01.336456 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1488429c-a79e-4e1b-a34d-c26a868e7562 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:01.408063 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1488429c-a79e-4e1b-a34d-c26a868e7562 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/action" status: 202 len: 0 microversion: 2.1 time: 0.088305 May 27 03:34:01.408674 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 488/995] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:34:01 2022] POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:34:01.418618 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:01.419317 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:01.421638 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:01.422360 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=26 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:01.428972 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:01.429421 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:01.430252 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:01.430689 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:01.683388 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:01.691519 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-21dcabc9-10bd-4441-98ae-e9340213f1b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1753 microversion: 2.1 time: 0.277803 May 27 03:34:01.692109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 508/996] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:01 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1753 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:02.710004 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:02.710686 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:02.716842 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:02.717280 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:02.718020 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:02.718444 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:02.913740 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:02.922267 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0acb8622-9485-41ba-9779-792a0a36288c tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.217126 May 27 03:34:02.922842 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 489/997] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:02 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:03.939525 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:03.940170 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:03.946745 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:03.947192 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:03.948589 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:03.949023 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:04.088282 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:04.096611 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3f8821a4-43be-430d-a371-e66787422101 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.160890 May 27 03:34:04.097579 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 509/998] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:03 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:05.113391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:05.113974 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:05.120423 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:05.120868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:05.121627 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:05.122059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:05.259902 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:05.268303 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-df7d08ff-6d27-4c3c-aa59-cd0f6b72b01e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.158742 May 27 03:34:05.268864 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 490/999] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:05 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:06.285713 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:06.286247 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:06.293345 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:06.293787 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:06.294567 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:06.294997 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:06.436592 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:06.444431 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-efe97883-5af8-4e51-8e0d-a983acefe6df tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.162609 May 27 03:34:06.444991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 510/1000] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:06 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:07.461679 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:07.462279 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:07.468341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:07.468791 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:07.469552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:07.469989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:07.610815 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:07.618715 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9b41837e-d02c-4e59-9e86-9732b710e90e tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.161299 May 27 03:34:07.619276 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 491/1001] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:07 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:08.627002 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8f8747e4-6227-4c9a-bcfc-5ffdcabe1455 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:08.627530 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8f8747e4-6227-4c9a-bcfc-5ffdcabe1455 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:08.633991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f8747e4-6227-4c9a-bcfc-5ffdcabe1455 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:08.634443 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f8747e4-6227-4c9a-bcfc-5ffdcabe1455 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:08.635198 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f8747e4-6227-4c9a-bcfc-5ffdcabe1455 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:08.635610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:08.636056 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8f8747e4-6227-4c9a-bcfc-5ffdcabe1455 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:08.636248 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:08.643211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:08.643658 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:08.644565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:08.644925 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:08.659352 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8f8747e4-6227-4c9a-bcfc-5ffdcabe1455 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/ips" status: 200 len: 150 microversion: 2.1 time: 0.036165 May 27 03:34:08.659944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 511/1002] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:34:08 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:08.786428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:08.797308 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c22bd00a-2c4c-441e-a4ff-626ac4e7e3ac tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.164120 May 27 03:34:08.797883 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 492/1003] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:08 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:34:09.814724 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:09.815380 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:09.822223 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:09.822658 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:09.823428 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:09.823905 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:09.969389 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:09.969624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-272d623d-e942-4768-b3b3-b4a0da2b4208 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6fd486a-1247-4381-b91d-2212d9da1bd5"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:09.970683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-272d623d-e942-4768-b3b3-b4a0da2b4208 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:09.977358 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-272d623d-e942-4768-b3b3-b4a0da2b4208 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:09.977798 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-272d623d-e942-4768-b3b3-b4a0da2b4208 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:09.978108 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a175a88c-bc10-4e2b-beab-425c2e292ee4 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.167220 May 27 03:34:09.978556 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-272d623d-e942-4768-b3b3-b4a0da2b4208 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:09.978965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 512/1004] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:09 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:09.979102 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-272d623d-e942-4768-b3b3-b4a0da2b4208 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:10.244976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-272d623d-e942-4768-b3b3-b4a0da2b4208 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279065 May 27 03:34:10.245614 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 493/1005] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:34:09 2022] POST /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:10.994331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:10.994949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:11.001458 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:11.001906 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:11.002672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:11.003111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:11.144214 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:11.152238 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-8b9f00fb-f47d-4ff9-972c-8fbf3297e4cc tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.161685 May 27 03:34:11.153404 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 513/1006] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:10 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:12.171527 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:12.172389 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:12.178582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:12.179030 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:12.179781 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:12.180243 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:12.326400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:12.334577 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f7869a55-115e-4a08-9f00-e872bd93b737 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.168447 May 27 03:34:12.335136 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 494/1007] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:12 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:13.351647 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:13.352273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:13.359459 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:13.359928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:13.360672 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:13.361108 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:13.500740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:13.508742 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e1c64c37-7369-450f-848d-d1e7993f7c89 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.160903 May 27 03:34:13.509301 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 514/1008] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:13 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:14.525548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:14.526146 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:14.532639 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:14.533078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:14.533820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:14.534244 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:14.673394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:14.681243 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9a504174-de5b-4342-9eba-25d5f6c5e468 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.159484 May 27 03:34:14.681793 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 495/1009] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:14 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:15.698604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:15.699217 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:15.706204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:15.706653 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:15.707405 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:15.707862 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:15.850962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:15.858849 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-99fcd7ab-a52b-44f2-a866-992424199bf5 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.164087 May 27 03:34:15.859404 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 515/1010] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:15 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:16.876029 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:16.876629 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:16.883348 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:16.883788 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:16.884594 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:16.885019 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:17.027813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:17.036418 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9b16540d-3d7e-4279-982c-ff35ed10d020 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.164227 May 27 03:34:17.036970 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 496/1011] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:16 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:17.742979 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6fd486a-1247-4381-b91d-2212d9da1bd5"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:17.744069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:17.751047 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:17.751498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:17.752343 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:17.752779 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:17.830144 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Invalid volume: volume c6fd486a-1247-4381-b91d-2212d9da1bd5 is already attached to instances: 20c99fc1-ceba-4a21-8037-49cc40802c0f May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: POST /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments HTTP/1.1 May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 74 May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:34:17.831962 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {"volumeAttachment": {"volumeId": "c6fd486a-1247-4381-b91d-2212d9da1bd5"}} May 27 03:34:17.833937 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Invalid volume: volume c6fd486a-1247-4381-b91d-2212d9da1bd5 is already attached to instances: 20c99fc1-ceba-4a21-8037-49cc40802c0f May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'server_id': '20c99fc1-ceba-4a21-8037-49cc40802c0f', 'body': {'volumeAttachment': {'volumeId': 'c6fd486a-1247-4381-b91d-2212d9da1bd5'}}} May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c6fd486a-1247-4381-b91d-2212d9da1bd5 is already attached to instances: 20c99fc1-ceba-4a21-8037-49cc40802c0f May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:17.834880 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c6fd486a-1247-4381-b91d-2212d9da1bd5 is already attached to instances: 20c99fc1-ceba-4a21-8037-49cc40802c0f May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:17.836366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c6fd486a-1247-4381-b91d-2212d9da1bd5 is already attached to instances: 20c99fc1-ceba-4a21-8037-49cc40802c0f May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 400 to user: Invalid volume: volume c6fd486a-1247-4381-b91d-2212d9da1bd5 is already attached to instances: 20c99fc1-ceba-4a21-8037-49cc40802c0f {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-96afe5cb-3e60-46c0-a1f2-0889a0104e3f tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094460 May 27 03:34:17.837933 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 516/1012] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:34:17 2022] POST /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:34:17.897896 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:17.898409 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:17.904815 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:17.905260 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:17.906012 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:17.906443 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:17.989617 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lazy-loading 'services' on Instance uuid 20c99fc1-ceba-4a21-8037-49cc40802c0f {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:34:18.052818 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:18.053436 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:18.059517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:18.059933 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a29d125a-111d-47c6-8cda-66634b84e7c1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments/c6fd486a-1247-4381-b91d-2212d9da1bd5" status: 202 len: 0 microversion: 2.1 time: 0.165750 May 27 03:34:18.060063 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:18.060520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 497/1013] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:34:17 2022] DELETE /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments/c6fd486a-1247-4381-b91d-2212d9da1bd5 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:34:18.060770 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:18.061207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:18.068873 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-99217158-b68c-4ce5-8d1f-26fb4520adf3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:18.069945 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-99217158-b68c-4ce5-8d1f-26fb4520adf3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:18.076075 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99217158-b68c-4ce5-8d1f-26fb4520adf3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:18.076520 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99217158-b68c-4ce5-8d1f-26fb4520adf3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:18.077275 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99217158-b68c-4ce5-8d1f-26fb4520adf3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:18.077704 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-99217158-b68c-4ce5-8d1f-26fb4520adf3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:18.107924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-99217158-b68c-4ce5-8d1f-26fb4520adf3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 May 27 03:34:18.108488 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 498/1014] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:34:18 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:18.214517 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:18.223009 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-04d371a6-39a4-4966-941c-a1b145c19986 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1758 microversion: 2.1 time: 0.174142 May 27 03:34:18.223572 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 517/1015] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:18 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:34:19.119305 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-484523e1-c53f-4d17-8edf-2b4f136f5473 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:19.120301 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-484523e1-c53f-4d17-8edf-2b4f136f5473 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:19.127251 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-484523e1-c53f-4d17-8edf-2b4f136f5473 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:19.127686 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-484523e1-c53f-4d17-8edf-2b4f136f5473 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:19.128459 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-484523e1-c53f-4d17-8edf-2b4f136f5473 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:19.128883 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-484523e1-c53f-4d17-8edf-2b4f136f5473 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:19.157744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-484523e1-c53f-4d17-8edf-2b4f136f5473 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042281 May 27 03:34:19.158303 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 499/1016] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:34:19 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:19.240234 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:19.240844 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:19.247465 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:19.247965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:19.248731 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:19.249166 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:19.389675 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:19.397616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-aafae10a-3dcf-43f5-a89f-77f2254f4953 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1761 microversion: 2.1 time: 0.161407 May 27 03:34:19.398177 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 518/1017] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:19 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:20.169207 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d368bd38-faf2-4f6f-aa71-934c39a19840 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:20.170116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d368bd38-faf2-4f6f-aa71-934c39a19840 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:20.177046 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d368bd38-faf2-4f6f-aa71-934c39a19840 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:20.177483 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d368bd38-faf2-4f6f-aa71-934c39a19840 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:20.178227 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d368bd38-faf2-4f6f-aa71-934c39a19840 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:20.178652 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d368bd38-faf2-4f6f-aa71-934c39a19840 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:20.206826 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d368bd38-faf2-4f6f-aa71-934c39a19840 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041522 May 27 03:34:20.207294 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 500/1018] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:34:20 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:34:20.270832 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:20.271363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:20.277791 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:20.278235 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:20.278991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:20.279425 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:20.311351 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:34:20.390884 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-44ece29b-28d1-4985-bcc7-0bfcaa4d8add tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 204 len: 0 microversion: 2.1 time: 0.123151 May 27 03:34:20.392078 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 519/1019] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:34:20 2022] DELETE /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:34:20.399978 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:20.400606 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:20.407307 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:20.407746 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:20.408616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:20.409043 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:20.428470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:20.539374 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:20.547455 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4ee960f0-a864-4d83-87d3-24412cb01736 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1679 microversion: 2.1 time: 0.151376 May 27 03:34:20.548048 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 501/1020] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:20 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:21.566582 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:21.567275 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:21.573769 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:21.574208 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:21.574964 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:21.575389 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:21.710102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:21.717739 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-37156855-2fd3-49e3-b73f-85d8fd49b469 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1679 microversion: 2.1 time: 0.155295 May 27 03:34:21.718313 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 520/1021] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:21 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:22.734914 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:22.735734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:22.742434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:22.742883 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:22.743647 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:22.744106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:22.813774 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:22.821980 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-44df393c-02f2-4fac-93d6-30efe1aeef4d tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 200 len: 1612 microversion: 2.1 time: 0.091333 May 27 03:34:22.822548 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 502/1022] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:22 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 1612 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:23.072203 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-7904ce61-7bd2-43e1-9772-239fced2da74 req-79aa0282-03cf-467c-a863-95d8b385642e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c99fc1-ceba-4a21-8037-49cc40802c0f", "name": "network-vif-deleted", "tag": "7af37490-4b36-4ff1-b478-34c104e7a6d7"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:23.082266 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-7904ce61-7bd2-43e1-9772-239fced2da74 req-79aa0282-03cf-467c-a863-95d8b385642e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:23.083014 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-7904ce61-7bd2-43e1-9772-239fced2da74 req-79aa0282-03cf-467c-a863-95d8b385642e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:23.096812 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-7904ce61-7bd2-43e1-9772-239fced2da74 req-79aa0282-03cf-467c-a863-95d8b385642e service nova] Creating event network-vif-deleted:7af37490-4b36-4ff1-b478-34c104e7a6d7 for instance 20c99fc1-ceba-4a21-8037-49cc40802c0f on hv-cinder-82880 May 27 03:34:23.102286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-7904ce61-7bd2-43e1-9772-239fced2da74 req-79aa0282-03cf-467c-a863-95d8b385642e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132399 May 27 03:34:23.104335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 521/1023] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:23.838947 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:23.839547 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:23.847114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:23.847564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:23.848347 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:23.848820 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:23.862263 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f HTTP/1.1 May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:34:23.863930 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:34:23.865624 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '20c99fc1-ceba-4a21-8037-49cc40802c0f'} May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:34:23.866719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:34:23.868400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:34:23.869857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:34:23.869857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d56d6580-9206-4ef8-8ed8-ce75ef5a3e4c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 404 len: 111 microversion: 2.1 time: 0.030167 May 27 03:34:23.869857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 503/1024] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:23 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:34:23.874841 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-38d952da-8b7d-47ad-9db6-8bef2a86c484 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '.version_select at 0x7f40c0e77c10>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:23.893359 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-38d952da-8b7d-47ad-9db6-8bef2a86c484 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-775770575" status: 202 len: 0 microversion: 2.1 time: 0.022565 May 27 03:34:23.894046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 522/1025] 10.222.0.62 () {58 vars in 1217 bytes} [Fri May 27 03:34:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-775770575 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:34:24.504999 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-225a3d70-ec21-46ff-afd0-15fd69743c9b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: .version_select at 0x7f40c03a9040>, body: {"keypair": {"name": "tempest-keypair-257049975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmEfPOKc1q4Ab1fr/fuF5q1Icp209i2S7NPv/mg6eSQU3rMl+Os2+wRyRx8t4wfdGIgElvW2gGcBwac7QmD1/WXb4au9qZeaklwoZJUT9n25C8eaorgJg2D4NVZUTpqQ=="}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:24.519126 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-225a3d70-ec21-46ff-afd0-15fd69743c9b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:34:24.522876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.quota [None req-225a3d70-ec21-46ff-afd0-15fd69743c9b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'key_pairs'} {{(pid=117609) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:34:24.543837 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-225a3d70-ec21-46ff-afd0-15fd69743c9b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042648 May 27 03:34:24.544555 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 504/1026] 10.222.0.62 () {60 vars in 1158 bytes} [Fri May 27 03:34:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:25.990930 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1262650812", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fca8f91-27a5-4216-bd00-e734abe0021c"}], "security_groups": [{"name": "tempest-securitygroup--1872772519"}], "key_name": "tempest-keypair-257049975", "user_data": "}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:26.092666 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] validate_networks() for [('5fca8f91-27a5-4216-bd00-e734abe0021c', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:34:26.455249 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:34:26.455661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:34:26.456163 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:34:26.456565 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:34:26.456966 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:34:26.466118 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:26.466557 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:26.467334 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:26.467754 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:26.483807 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:34:26.487716 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Getting quotas for user 4bf0025854d64392810c6c9303eb9320 and project 6a6c40fbca064c789708300a00c36ce4. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:34:26.498401 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:34:26.501247 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:34:26.547910 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-27eb3907-7dec-43e0-ac7b-18eb432012b1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561728 May 27 03:34:26.548573 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 523/1027] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:34:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:34:26.558908 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-93045d76-11c6-4f86-9b3d-36f4a36b4861 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:26.559511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-93045d76-11c6-4f86-9b3d-36f4a36b4861 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:26.614732 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-93045d76-11c6-4f86-9b3d-36f4a36b4861 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:26.621508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-93045d76-11c6-4f86-9b3d-36f4a36b4861 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1241 microversion: 2.1 time: 0.066897 May 27 03:34:26.622059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 505/1028] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:26 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:34:27.639394 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:27.640199 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:27.648848 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:27.649376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:27.650556 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:27.651077 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:27.725653 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:27.734913 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b198805e-e7b6-4571-a54a-b0d21721b1b5 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1301 microversion: 2.1 time: 0.099541 May 27 03:34:27.735569 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 524/1029] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:27 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:28.753103 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:28.753629 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:28.760321 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:28.760763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:28.761511 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:28.761938 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:28.970135 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:28.977713 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-bba93e4a-3f02-4832-93c2-b983d8658855 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1367 microversion: 2.1 time: 0.229008 May 27 03:34:28.978285 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 506/1030] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:28 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:29.304152 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-e6321fb7-62e0-4b14-8796-9c9027768223 req-27de7d39-d5e1-439a-94cd-efc0e2ebbe88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e57f92-f92b-45d5-8024-4e94ec01301d", "tag": "53fe3a50-ab92-4271-bccf-e7325b0613e1"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:29.313670 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-e6321fb7-62e0-4b14-8796-9c9027768223 req-27de7d39-d5e1-439a-94cd-efc0e2ebbe88 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:29.314523 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-e6321fb7-62e0-4b14-8796-9c9027768223 req-27de7d39-d5e1-439a-94cd-efc0e2ebbe88 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:29.334207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-e6321fb7-62e0-4b14-8796-9c9027768223 req-27de7d39-d5e1-439a-94cd-efc0e2ebbe88 service nova] Creating event network-changed:53fe3a50-ab92-4271-bccf-e7325b0613e1 for instance 92e57f92-f92b-45d5-8024-4e94ec01301d on hv-cinder-82880 May 27 03:34:29.339399 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-e6321fb7-62e0-4b14-8796-9c9027768223 req-27de7d39-d5e1-439a-94cd-efc0e2ebbe88 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039238 May 27 03:34:29.347293 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 525/1031] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:29.994792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:29.995493 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:30.001863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:30.002307 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:30.003052 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:30.003481 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:30.128897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:30.136101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-aaba9148-29c3-4913-b232-287c186e226c tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1367 microversion: 2.1 time: 0.145547 May 27 03:34:30.136662 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 507/1032] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:29 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:31.154507 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:31.155129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:31.161921 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:31.162370 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:31.163133 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:31.163567 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:31.167576 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:31.296833 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:31.304465 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-85b9dd57-1630-4f3f-918f-2db57277c8af tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1367 microversion: 2.1 time: 0.154739 May 27 03:34:31.305035 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 526/1033] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:31 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:32.321725 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:32.322331 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:32.324658 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:32.330563 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:32.331000 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:32.331744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:32.332194 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:32.461434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:32.468773 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e3aac566-4958-424f-935d-97a00d197311 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1367 microversion: 2.1 time: 0.150852 May 27 03:34:32.469334 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 508/1034] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:32 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:33.485966 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:33.486583 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:33.488954 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:33.495174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:33.495628 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:33.496415 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:33.496858 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:33.634597 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:33.641974 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f5b31c1a-e748-42d2-8206-3b47ea962182 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1367 microversion: 2.1 time: 0.159886 May 27 03:34:33.643149 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 527/1035] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:33 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:34.215526 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-b925b6d9-8015-4bed-a84d-32147c35c6ad req-efe1d787-a368-44b6-80a5-8604626dd1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e57f92-f92b-45d5-8024-4e94ec01301d", "name": "network-vif-plugged", "status": "completed", "tag": "53fe3a50-ab92-4271-bccf-e7325b0613e1"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:34.226003 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-b925b6d9-8015-4bed-a84d-32147c35c6ad req-efe1d787-a368-44b6-80a5-8604626dd1d0 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:34.226773 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-b925b6d9-8015-4bed-a84d-32147c35c6ad req-efe1d787-a368-44b6-80a5-8604626dd1d0 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:34.238305 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-b925b6d9-8015-4bed-a84d-32147c35c6ad req-efe1d787-a368-44b6-80a5-8604626dd1d0 service nova] Creating event network-vif-plugged:53fe3a50-ab92-4271-bccf-e7325b0613e1 for instance 92e57f92-f92b-45d5-8024-4e94ec01301d on hv-cinder-82880 May 27 03:34:34.243392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-b925b6d9-8015-4bed-a84d-32147c35c6ad req-efe1d787-a368-44b6-80a5-8604626dd1d0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031415 May 27 03:34:34.244389 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 509/1036] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:34.660563 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:34.661167 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:34.667743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:34.668240 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:34.668987 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:34.669413 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:34.793578 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:34.800870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-106b87c1-73f5-406b-8854-d85d32566ee2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1367 microversion: 2.1 time: 0.145435 May 27 03:34:34.801429 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 528/1037] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:34 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:35.818767 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:35.819450 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:35.826199 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:35.826640 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:35.827384 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:35.827812 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:35.957429 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:35.965059 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-61d320e9-6d62-4b94-b9f3-de31d430b7c2 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1367 microversion: 2.1 time: 0.150931 May 27 03:34:35.965619 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 510/1038] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:35 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:36.982132 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:36.982748 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:36.985329 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:36.985999 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=6 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:36.992611 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:36.993060 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:36.993819 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:36.994252 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:37.124252 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:37.131785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-2ffc4f61-05a6-4db1-9103-306f2958f6b7 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1557 microversion: 2.1 time: 0.153838 May 27 03:34:37.132374 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 529/1039] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:36 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:37.148403 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-794d7a81-a273-46ea-909e-47443f8052ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:37.148922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-794d7a81-a273-46ea-909e-47443f8052ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:37.150918 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=6 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:37.156955 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-794d7a81-a273-46ea-909e-47443f8052ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:37.157399 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-794d7a81-a273-46ea-909e-47443f8052ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:37.158154 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-794d7a81-a273-46ea-909e-47443f8052ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:37.159163 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-794d7a81-a273-46ea-909e-47443f8052ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:37.233364 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-794d7a81-a273-46ea-909e-47443f8052ed tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088694 May 27 03:34:37.233950 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 511/1040] 10.222.0.62 () {58 vars in 1274 bytes} [Fri May 27 03:34:37 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:38.354984 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-512abc7d-657a-422b-b473-82b43e675411 req-25cc2509-03b5-4b40-9ca3-647af979c8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e57f92-f92b-45d5-8024-4e94ec01301d", "tag": "53fe3a50-ab92-4271-bccf-e7325b0613e1"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:38.363474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-512abc7d-657a-422b-b473-82b43e675411 req-25cc2509-03b5-4b40-9ca3-647af979c8bd service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:38.363931 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-512abc7d-657a-422b-b473-82b43e675411 req-25cc2509-03b5-4b40-9ca3-647af979c8bd service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:38.374823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-512abc7d-657a-422b-b473-82b43e675411 req-25cc2509-03b5-4b40-9ca3-647af979c8bd service nova] Creating event network-changed:53fe3a50-ab92-4271-bccf-e7325b0613e1 for instance 92e57f92-f92b-45d5-8024-4e94ec01301d on hv-cinder-82880 May 27 03:34:38.379738 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-512abc7d-657a-422b-b473-82b43e675411 req-25cc2509-03b5-4b40-9ca3-647af979c8bd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029012 May 27 03:34:38.380355 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 530/1041] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:53.229842 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=7 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:53.230565 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=40 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:53.234522 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1929362669"}} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:53.235039 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:53.241728 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:53.242165 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:53.242903 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:53.243329 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:53.367154 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.network.security_group_api [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Removing security group 1cd3d8bd-6c29-444c-a5b4-2c39179e198a from port 6c377781-a67e-4b85-a7a6-00d1694a82dc May 27 03:34:53.736386 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3e569ab8-a120-4390-b46c-617efd54a4b1 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/action" status: 202 len: 0 microversion: 2.1 time: 0.507681 May 27 03:34:53.737176 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 512/1042] 10.222.0.62 () {60 vars in 1277 bytes} [Fri May 27 03:34:53 2022] POST /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:34:53.750230 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-fb5efd4d-4a41-4806-bd22-86f6ceca9f3c req-5c50d32f-2436-4b7e-8cf4-065b56e502e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626e76e5-4962-45d3-accd-406dfc8dae92", "tag": "6c377781-a67e-4b85-a7a6-00d1694a82dc"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:53.764054 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=7 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:53.765224 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=24 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:53.768683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-fb5efd4d-4a41-4806-bd22-86f6ceca9f3c req-5c50d32f-2436-4b7e-8cf4-065b56e502e7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:53.769651 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-fb5efd4d-4a41-4806-bd22-86f6ceca9f3c req-5c50d32f-2436-4b7e-8cf4-065b56e502e7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:53.784046 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-fb5efd4d-4a41-4806-bd22-86f6ceca9f3c req-5c50d32f-2436-4b7e-8cf4-065b56e502e7 service nova] Creating event network-changed:6c377781-a67e-4b85-a7a6-00d1694a82dc for instance 626e76e5-4962-45d3-accd-406dfc8dae92 on hv-cinder-82880 May 27 03:34:53.792193 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-fb5efd4d-4a41-4806-bd22-86f6ceca9f3c req-5c50d32f-2436-4b7e-8cf4-065b56e502e7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049323 May 27 03:34:53.793254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 531/1043] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:54.813078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:54.813610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:54.814969 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-3fa0df9c-6df1-4471-ba24-67f16d6e6d13 req-7e4f04dd-77f6-415e-b430-914114bb41d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626e76e5-4962-45d3-accd-406dfc8dae92", "tag": "6c377781-a67e-4b85-a7a6-00d1694a82dc"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:54.821628 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:54.822388 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:54.823377 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:54.824034 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:54.824331 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3fa0df9c-6df1-4471-ba24-67f16d6e6d13 req-7e4f04dd-77f6-415e-b430-914114bb41d7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:54.824823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-3fa0df9c-6df1-4471-ba24-67f16d6e6d13 req-7e4f04dd-77f6-415e-b430-914114bb41d7 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:54.836247 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-3fa0df9c-6df1-4471-ba24-67f16d6e6d13 req-7e4f04dd-77f6-415e-b430-914114bb41d7 service nova] Creating event network-changed:6c377781-a67e-4b85-a7a6-00d1694a82dc for instance 626e76e5-4962-45d3-accd-406dfc8dae92 on hv-cinder-82880 May 27 03:34:54.841561 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-3fa0df9c-6df1-4471-ba24-67f16d6e6d13 req-7e4f04dd-77f6-415e-b430-914114bb41d7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031012 May 27 03:34:54.842685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 532/1044] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:54.909986 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lazy-loading 'services' on Instance uuid 626e76e5-4962-45d3-accd-406dfc8dae92 {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:34:54.995269 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0e82f779-aeec-4c6f-872f-ffa0bbecc014 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "DELETE /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments/948f92d6-5de0-48d6-8668-5790a278c83d" status: 202 len: 0 microversion: 2.1 time: 0.186517 May 27 03:34:54.999641 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 513/1045] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:34:54 2022] DELETE /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments/948f92d6-5de0-48d6-8668-5790a278c83d => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:34:55.005946 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ab147dd0-601c-41db-a61e-c626b539f8f7 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:55.007300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ab147dd0-601c-41db-a61e-c626b539f8f7 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:55.014083 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ab147dd0-601c-41db-a61e-c626b539f8f7 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:55.014604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ab147dd0-601c-41db-a61e-c626b539f8f7 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:55.015730 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ab147dd0-601c-41db-a61e-c626b539f8f7 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:55.016551 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ab147dd0-601c-41db-a61e-c626b539f8f7 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:55.051291 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ab147dd0-601c-41db-a61e-c626b539f8f7 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049773 May 27 03:34:55.052481 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 533/1046] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:34:54 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:56.063718 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c936b285-c910-4eee-a4fc-bb0f081044ee tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:56.064830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c936b285-c910-4eee-a4fc-bb0f081044ee tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:56.071463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c936b285-c910-4eee-a4fc-bb0f081044ee tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:56.071940 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c936b285-c910-4eee-a4fc-bb0f081044ee tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:56.072684 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c936b285-c910-4eee-a4fc-bb0f081044ee tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:56.073110 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c936b285-c910-4eee-a4fc-bb0f081044ee tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:56.102879 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c936b285-c910-4eee-a4fc-bb0f081044ee tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043947 May 27 03:34:56.103420 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 514/1047] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:34:56 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:34:56.113250 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:56.113750 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:56.120342 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:56.120823 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:56.121585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:56.122024 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:56.197381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] HTTP exception thrown: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 is not attached to volume 948f92d6-5de0-48d6-8668-5790a278c83d May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Request method failure captured: May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: DELETE /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments/948f92d6-5de0-48d6-8668-5790a278c83d HTTP/1.1 May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEZe8qrU45YmMriDgcxQWLoI_A5SjDixRHDhr99cm2hxTAqEifa2rJ4TCjsRVYtqxQbM62pLY3aInnjKxTMPYwKzhAOvSBqBTUfo2N_N3zTt2CocmknPPxBGMKKQ_nLbxfubY2s-_MAVTXbsGGGnmXCYELL3R6pmHKPiOxDplVfb25k May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 54f9fd67a8e2485eba03336c3b0b6b4e May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-TestMinimumBasicScenario-7771936 May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:34:56.199776 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_54f9fd67a8e2485eba03336c3b0b6b4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/54f9fd67a8e2485eba03336c3b0b6b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/54f9fd67a8e2485eba03336c3b0b6b4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/54f9fd67a8e2485eba03336c3b0b6b4e"}]}] May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-TestMinimumBasicScenario-7771936 May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 54f9fd67a8e2485eba03336c3b0b6b4e May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-TestMinimumBasicScenario-7771936 May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-TestMinimumBasicScenario-7771936-project May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 5220c5f89d8b4841922a592cbd268c4b May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-TestMinimumBasicScenario-7771936-project May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:34:56.201518 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 is not attached to volume 948f92d6-5de0-48d6-8668-5790a278c83d May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'server_id': '626e76e5-4962-45d3-accd-406dfc8dae92', 'id': '948f92d6-5de0-48d6-8668-5790a278c83d'} May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 948f92d6-5de0-48d6-8668-5790a278c83d. May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:34:56.202427 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 is not attached to volume 948f92d6-5de0-48d6-8668-5790a278c83d May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 is not attached to volume 948f92d6-5de0-48d6-8668-5790a278c83d May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:34:56.203965 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Returning 404 to user: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 is not attached to volume 948f92d6-5de0-48d6-8668-5790a278c83d {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:34:56.205122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e9e19132-7ffb-4f65-af2e-791699663151 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "DELETE /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments/948f92d6-5de0-48d6-8668-5790a278c83d" status: 404 len: 154 microversion: 2.1 time: 0.091941 May 27 03:34:56.205122 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 534/1048] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:34:56 2022] DELETE /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92/os-volume_attachments/948f92d6-5de0-48d6-8668-5790a278c83d => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:34:57.332550 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:57.333028 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:57.339665 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:57.340144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:57.340896 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:57.341334 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:57.365395 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:34:57.437005 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-fa74d6de-b70e-4c42-8936-6f10a7373650 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "DELETE /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 204 len: 0 microversion: 2.1 time: 0.108506 May 27 03:34:57.437809 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 515/1049] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:34:57 2022] DELETE /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:34:57.448222 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:57.448839 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:57.455602 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:57.456088 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:57.457663 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:57.458110 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:57.592707 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:57.600294 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d16a0121-b278-474a-a697-036467d81a33 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1556 microversion: 2.1 time: 0.157110 May 27 03:34:57.600850 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 535/1050] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:57 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:58.618610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:58.619324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:58.625779 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:58.626231 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:58.626985 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:58.627422 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:58.756616 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:58.764053 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-27e04fed-1c06-4280-a21b-9d3d71099b47 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1556 microversion: 2.1 time: 0.149890 May 27 03:34:58.764611 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 516/1051] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:58 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:59.784255 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:59.785425 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:59.792037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:59.792575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:59.793593 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:59.794149 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:59.836257 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-4ec7bdd1-c0e9-48c8-a0e1-1b5267175b26 req-c32f87e8-600e-4d04-9ab6-801042802586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626e76e5-4962-45d3-accd-406dfc8dae92", "name": "network-vif-deleted", "tag": "6c377781-a67e-4b85-a7a6-00d1694a82dc"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:59.845747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-4ec7bdd1-c0e9-48c8-a0e1-1b5267175b26 req-c32f87e8-600e-4d04-9ab6-801042802586 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:59.846468 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-4ec7bdd1-c0e9-48c8-a0e1-1b5267175b26 req-c32f87e8-600e-4d04-9ab6-801042802586 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:59.859056 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-4ec7bdd1-c0e9-48c8-a0e1-1b5267175b26 req-c32f87e8-600e-4d04-9ab6-801042802586 service nova] Creating event network-vif-deleted:6c377781-a67e-4b85-a7a6-00d1694a82dc for instance 626e76e5-4962-45d3-accd-406dfc8dae92 on hv-cinder-82880 May 27 03:34:59.865901 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5220c5f89d8b4841922a592cbd268c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f9fd67a8e2485eba03336c3b0b6b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:59.870837 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-4ec7bdd1-c0e9-48c8-a0e1-1b5267175b26 req-c32f87e8-600e-4d04-9ab6-801042802586 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037996 May 27 03:34:59.871439 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 517/1052] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:59.875025 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c8fd41bd-31f5-4348-82d9-130c20f1e64a tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 200 len: 1514 microversion: 2.1 time: 0.098528 May 27 03:34:59.875602 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 536/1053] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:34:59 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 1514 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:00.892299 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:00.892987 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] [instance: 626e76e5-4962-45d3-accd-406dfc8dae92] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:00.899187 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:00.899627 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:00.900404 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:00.900833 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:00.913911 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] HTTP exception thrown: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 could not be found. May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Request method failure captured: May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 HTTP/1.1 May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEZe8qrU45YmMriDgcxQWLoI_A5SjDixRHDhr99cm2hxTAqEifa2rJ4TCjsRVYtqxQbM62pLY3aInnjKxTMPYwKzhAOvSBqBTUfo2N_N3zTt2CocmknPPxBGMKKQ_nLbxfubY2s-_MAVTXbsGGGnmXCYELL3R6pmHKPiOxDplVfb25k May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 54f9fd67a8e2485eba03336c3b0b6b4e May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-TestMinimumBasicScenario-7771936 May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:35:00.915502 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_54f9fd67a8e2485eba03336c3b0b6b4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/54f9fd67a8e2485eba03336c3b0b6b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/54f9fd67a8e2485eba03336c3b0b6b4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/54f9fd67a8e2485eba03336c3b0b6b4e"}]}] May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-TestMinimumBasicScenario-7771936 May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 54f9fd67a8e2485eba03336c3b0b6b4e May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-TestMinimumBasicScenario-7771936 May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-TestMinimumBasicScenario-7771936-project May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 5220c5f89d8b4841922a592cbd268c4b May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-TestMinimumBasicScenario-7771936-project May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 could not be found. May 27 03:35:00.916963 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '626e76e5-4962-45d3-accd-406dfc8dae92'} May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 could not be found. May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:00.918101 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 could not be found. May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 could not be found. May 27 03:35:00.919490 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:00.920901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Returning 404 to user: Instance 626e76e5-4962-45d3-accd-406dfc8dae92 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:00.920901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-31ef4434-353b-41d0-a745-ace78b289798 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92" status: 404 len: 111 microversion: 2.1 time: 0.029255 May 27 03:35:00.920901 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 518/1054] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:00 2022] GET /compute/v2.1/servers/626e76e5-4962-45d3-accd-406dfc8dae92 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:00.926786 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-22dc19a6-e43f-419f-95cd-6c12f99d2646 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] Calling method '.version_select at 0x7f40c0b01940>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:00.944254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-22dc19a6-e43f-419f-95cd-6c12f99d2646 tempest-TestMinimumBasicScenario-7771936 tempest-TestMinimumBasicScenario-7771936-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1283411233" status: 202 len: 0 microversion: 2.1 time: 0.021638 May 27 03:35:00.944810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 537/1055] 10.222.0.62 () {58 vars in 1271 bytes} [Fri May 27 03:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1283411233 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:35:14.443969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c5d779a6-3279-4ec4-a316-33c493dfbab0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:14.444522 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c5d779a6-3279-4ec4-a316-33c493dfbab0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:14.446646 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:14.447453 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:14.454024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c5d779a6-3279-4ec4-a316-33c493dfbab0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:14.454465 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c5d779a6-3279-4ec4-a316-33c493dfbab0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:14.455220 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c5d779a6-3279-4ec4-a316-33c493dfbab0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:14.455655 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c5d779a6-3279-4ec4-a316-33c493dfbab0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:14.480152 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c5d779a6-3279-4ec4-a316-33c493dfbab0 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/ips" status: 200 len: 150 microversion: 2.1 time: 0.040731 May 27 03:35:14.480697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 519/1056] 10.222.0.62 () {58 vars in 1247 bytes} [Fri May 27 03:35:14 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:15.798944 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=28 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:15.799685 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:15.804109 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a75b27e7-1e7c-4127-8c61-a299263dd118 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69a87919-2f17-462f-853b-c3c267fa5c91"}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:15.805150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a75b27e7-1e7c-4127-8c61-a299263dd118 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:15.813822 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a75b27e7-1e7c-4127-8c61-a299263dd118 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:15.814271 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a75b27e7-1e7c-4127-8c61-a299263dd118 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:15.815030 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a75b27e7-1e7c-4127-8c61-a299263dd118 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:15.815464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a75b27e7-1e7c-4127-8c61-a299263dd118 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:16.064591 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a75b27e7-1e7c-4127-8c61-a299263dd118 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "POST /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266912 May 27 03:35:16.068636 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 538/1057] 10.222.0.62 () {60 vars in 1322 bytes} [Fri May 27 03:35:15 2022] POST /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:23.639615 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:23.640155 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:23.646747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:23.647195 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:23.647984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:23.648419 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:23.727365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.objects.instance [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lazy-loading 'services' on Instance uuid 92e57f92-f92b-45d5-8024-4e94ec01301d {{(pid=117609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:35:23.799115 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-a04620b9-d149-450a-a647-bb424d93aa3b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments/69a87919-2f17-462f-853b-c3c267fa5c91" status: 202 len: 0 microversion: 2.1 time: 0.163163 May 27 03:35:23.799705 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 520/1058] 10.222.0.62 () {58 vars in 1415 bytes} [Fri May 27 03:35:23 2022] DELETE /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments/69a87919-2f17-462f-853b-c3c267fa5c91 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:35:23.810900 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ec28c700-2493-4abb-bfe7-c397c8eb5170 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:23.812387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ec28c700-2493-4abb-bfe7-c397c8eb5170 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:23.822303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec28c700-2493-4abb-bfe7-c397c8eb5170 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:23.822743 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec28c700-2493-4abb-bfe7-c397c8eb5170 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:23.823510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec28c700-2493-4abb-bfe7-c397c8eb5170 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:23.823989 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ec28c700-2493-4abb-bfe7-c397c8eb5170 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:23.857485 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ec28c700-2493-4abb-bfe7-c397c8eb5170 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051815 May 27 03:35:23.858034 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 539/1059] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:35:23 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:24.870811 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2138c2d3-6b4e-4488-9f66-de4166c02a67 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:24.871869 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2138c2d3-6b4e-4488-9f66-de4166c02a67 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:24.878107 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2138c2d3-6b4e-4488-9f66-de4166c02a67 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:24.878582 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2138c2d3-6b4e-4488-9f66-de4166c02a67 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:24.879339 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2138c2d3-6b4e-4488-9f66-de4166c02a67 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:24.879773 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2138c2d3-6b4e-4488-9f66-de4166c02a67 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:24.907941 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2138c2d3-6b4e-4488-9f66-de4166c02a67 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041997 May 27 03:35:24.908488 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 521/1060] 10.222.0.62 () {58 vars in 1301 bytes} [Fri May 27 03:35:24 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:35:24.966034 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:24.966524 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:24.972949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:24.973391 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:24.974136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:24.975194 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:24.999374 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:35:25.074526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e7e4b0ce-9543-499a-bcef-36403a3e411b tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 204 len: 0 microversion: 2.1 time: 0.112067 May 27 03:35:25.075307 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 540/1061] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:24 2022] DELETE /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:35:25.083610 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:25.084745 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:25.091061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:25.091563 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:25.092404 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:25.092835 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:25.220013 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:25.227403 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-16f60c6d-7581-4d0e-b894-fad826aa4c26 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1682 microversion: 2.1 time: 0.147970 May 27 03:35:25.227989 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 522/1062] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:25 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:26.245761 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:26.246451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:26.253179 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:26.253622 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:26.254369 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:26.254798 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:26.382174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:26.389691 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c1eaf395-158c-4abe-b7fc-e2341632d3b3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1682 microversion: 2.1 time: 0.148088 May 27 03:35:26.390248 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 541/1063] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:26 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:27.407271 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:27.407903 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:27.414851 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:27.415295 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:27.416080 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:27.416519 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:27.510250 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf0025854d64392810c6c9303eb9320', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6c40fbca064c789708300a00c36ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:27.518044 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-837fd920-af67-4543-a95a-e40387cf2a03 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 200 len: 1614 microversion: 2.1 time: 0.114664 May 27 03:35:27.518808 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 523/1064] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:27 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 1614 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:27.575740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-ea5fa029-816f-4b1d-90c4-ed9a3c36ee97 req-2b209fc3-176d-4a3a-b807-2e79ca3249a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e57f92-f92b-45d5-8024-4e94ec01301d", "name": "network-vif-deleted", "tag": "53fe3a50-ab92-4271-bccf-e7325b0613e1"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:27.585633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ea5fa029-816f-4b1d-90c4-ed9a3c36ee97 req-2b209fc3-176d-4a3a-b807-2e79ca3249a6 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:27.586075 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ea5fa029-816f-4b1d-90c4-ed9a3c36ee97 req-2b209fc3-176d-4a3a-b807-2e79ca3249a6 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:27.598358 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-ea5fa029-816f-4b1d-90c4-ed9a3c36ee97 req-2b209fc3-176d-4a3a-b807-2e79ca3249a6 service nova] Creating event network-vif-deleted:53fe3a50-ab92-4271-bccf-e7325b0613e1 for instance 92e57f92-f92b-45d5-8024-4e94ec01301d on hv-cinder-82880 May 27 03:35:27.605977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-ea5fa029-816f-4b1d-90c4-ed9a3c36ee97 req-2b209fc3-176d-4a3a-b807-2e79ca3249a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 May 27 03:35:27.606633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 542/1065] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:28.534438 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:28.535036 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:28.541654 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:28.542102 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:28.542868 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:28.543302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:28.558649 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d HTTP/1.1 May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:35:28.560333 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:28.562060 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '92e57f92-f92b-45d5-8024-4e94ec01301d'} May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:28.563379 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:28.564862 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:28.566737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:28.566737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-633c8727-7d8a-4d7f-a136-5fb280f74796 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 404 len: 111 microversion: 2.1 time: 0.031219 May 27 03:35:28.566737 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 524/1066] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:28 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:28.572016 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-daa06580-ac97-40b5-a30b-08b11e6707d3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '.version_select at 0x7f40c0fa7160>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:28.594810 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-daa06580-ac97-40b5-a30b-08b11e6707d3 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257049975" status: 202 len: 0 microversion: 2.1 time: 0.027624 May 27 03:35:28.595600 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 543/1067] 10.222.0.62 () {58 vars in 1217 bytes} [Fri May 27 03:35:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257049975 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:35:30.312924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:30.313416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:30.320471 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:30.320911 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:30.321658 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:30.322088 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:30.335223 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d HTTP/1.1 May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:35:30.336757 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.338434 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '92e57f92-f92b-45d5-8024-4e94ec01301d'} May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:30.339360 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.340676 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:30.342205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:30.342205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-93491ac7-bb74-477d-a1e7-2e16e07f3445 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 404 len: 111 microversion: 2.1 time: 0.029071 May 27 03:35:30.342205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 525/1068] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:30 2022] DELETE /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:35:30.347039 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:30.347767 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 92e57f92-f92b-45d5-8024-4e94ec01301d] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:30.354438 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:30.354882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:30.355634 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:30.356116 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:30.369474 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d HTTP/1.1 May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:35:30.371089 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.372734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '92e57f92-f92b-45d5-8024-4e94ec01301d'} May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:30.373772 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. May 27 03:35:30.375314 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:30.376922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 92e57f92-f92b-45d5-8024-4e94ec01301d could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:30.376922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-ce917efd-26d5-4b8a-84a1-2b697bb82a5a tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d" status: 404 len: 111 microversion: 2.1 time: 0.029699 May 27 03:35:30.376922 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 544/1069] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:30 2022] GET /compute/v2.1/servers/92e57f92-f92b-45d5-8024-4e94ec01301d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:31.505770 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:31.506792 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:31.513161 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.513606 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.514396 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.514780 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.528978 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f HTTP/1.1 May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:35:31.530414 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.532096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '20c99fc1-ceba-4a21-8037-49cc40802c0f'} May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:31.535813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.537128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.538400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:31.538400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-7ab8033b-1634-449a-99a0-ce7c3835a6bb tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 404 len: 111 microversion: 2.1 time: 0.029904 May 27 03:35:31.538400 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 526/1070] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:31 2022] DELETE /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:31.540231 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:31.540842 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 20c99fc1-ceba-4a21-8037-49cc40802c0f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:31.547232 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.547678 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.548464 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.548895 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.562870 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f HTTP/1.1 May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:35:31.564418 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.565835 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '20c99fc1-ceba-4a21-8037-49cc40802c0f'} May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:31.566632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. May 27 03:35:31.567973 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.569736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 20c99fc1-ceba-4a21-8037-49cc40802c0f could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:31.569736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-890c8d7f-0284-4599-aee7-33b7db6d9079 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f" status: 404 len: 111 microversion: 2.1 time: 0.029389 May 27 03:35:31.569736 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 545/1071] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:31 2022] GET /compute/v2.1/servers/20c99fc1-ceba-4a21-8037-49cc40802c0f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:35:31.575070 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:31.575568 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:31.581664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.582106 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.582858 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.583288 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.596841 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 HTTP/1.1 May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:35:31.598365 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.600084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'b123a0ef-15b7-4266-9c68-59a1515077b2'} May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:31.601116 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.602716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:31.604566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:31.604566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0ae07b14-121d-4b93-b198-821452cf5811 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 404 len: 111 microversion: 2.1 time: 0.028448 May 27 03:35:31.604566 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 527/1072] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:31 2022] DELETE /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:31.608176 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:31.608781 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: b123a0ef-15b7-4266-9c68-59a1515077b2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:31.614681 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.615138 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.616416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:31.616848 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:31.630097 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 HTTP/1.1 May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:35:31.632174 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.633740 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'b123a0ef-15b7-4266-9c68-59a1515077b2'} May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:31.634544 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. May 27 03:35:31.635865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:31.637069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance b123a0ef-15b7-4266-9c68-59a1515077b2 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:31.637069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-da1a5591-c5c1-45c1-ab90-1343afd55cd1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2" status: 404 len: 111 microversion: 2.1 time: 0.029103 May 27 03:35:31.637069 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 546/1073] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:31 2022] GET /compute/v2.1/servers/b123a0ef-15b7-4266-9c68-59a1515077b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:35:32.086553 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:32.087161 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:32.088462 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-61eb1f58-4c38-4968-ac68-f44c246c135c req-3f0c2b04-c0ee-4567-b3cb-4ad5e81c7593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd8487d-5eed-4492-b1ce-5a260cc7292f", "tag": "0043daec-332d-4272-9b40-80a037bc94a6"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:32.094259 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.094829 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.095697 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.096254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.096708 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-61eb1f58-4c38-4968-ac68-f44c246c135c req-3f0c2b04-c0ee-4567-b3cb-4ad5e81c7593 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.097150 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-61eb1f58-4c38-4968-ac68-f44c246c135c req-3f0c2b04-c0ee-4567-b3cb-4ad5e81c7593 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.109300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-61eb1f58-4c38-4968-ac68-f44c246c135c req-3f0c2b04-c0ee-4567-b3cb-4ad5e81c7593 service nova] Creating event network-changed:0043daec-332d-4272-9b40-80a037bc94a6 for instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f on hv-cinder-82880 May 27 03:35:32.114702 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-61eb1f58-4c38-4968-ac68-f44c246c135c req-3f0c2b04-c0ee-4567-b3cb-4ad5e81c7593 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030097 May 27 03:35:32.116003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 547/1074] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:35:32.124378 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:35:32.205604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1cf0042b-74e0-49a6-96ff-94353bf90af1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 204 len: 0 microversion: 2.1 time: 0.122977 May 27 03:35:32.206407 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 528/1075] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:32 2022] DELETE /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:35:32.216942 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:32.217804 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:32.224605 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.225858 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.226734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.227274 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.374853 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:32.382557 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3139929b-78d0-4da7-86eb-352e44bbcf68 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1576 microversion: 2.1 time: 0.171424 May 27 03:35:32.383129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 548/1076] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:32 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:35:32.777127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:32.777781 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:32.784293 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.784673 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.785428 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.785853 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.799200 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 HTTP/1.1 May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:35:32.801021 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.802663 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': '4725f793-67be-47c7-a4c6-07ccb2be4a57'} May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:32.803499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.804817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:32.806109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:32.806109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f2a72c4b-6647-4f9c-8ec2-592c68ff4924 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 404 len: 111 microversion: 2.1 time: 0.029428 May 27 03:35:32.806109 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 529/1077] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:32 2022] DELETE /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:32.810951 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:32.811542 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] [instance: 4725f793-67be-47c7-a4c6-07ccb2be4a57] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:32.817924 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.818366 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.819653 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:32.820101 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:32.834071 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] HTTP exception thrown: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Request method failure captured: May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 HTTP/1.1 May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEXis4JsMJB7JqksN9unkXHou7l2NxbuisjUgxwOZpR10BB2N-DSX_ccRb2zPEZhHaphxZB3cj8wmsq88DpU-5-_f-aDZZ8rdZkKez9CKGxZdu9xFlTB3IIEnTatNnendpRE6r-GBPeSRPxlGjiNcqVM1dQUHord3gdy1yQcPXzN_mY May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:35:32.836470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a6c40fbca064c789708300a00c36ce4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a6c40fbca064c789708300a00c36ce4"}]}] May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: 6a6c40fbca064c789708300a00c36ce4 May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-539635676 May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 4bf0025854d64392810c6c9303eb9320 May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-AttachVolumeNegativeTest-539635676-project May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.838136 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '4725f793-67be-47c7-a4c6-07ccb2be4a57'} May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:32.839037 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. May 27 03:35:32.840562 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:32.842585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] Returning 404 to user: Instance 4725f793-67be-47c7-a4c6-07ccb2be4a57 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:32.842585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-60c2db91-65b2-42f8-a02e-163b58d710e1 tempest-AttachVolumeNegativeTest-539635676 tempest-AttachVolumeNegativeTest-539635676-project] 10.222.0.62 "GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57" status: 404 len: 111 microversion: 2.1 time: 0.032044 May 27 03:35:32.842585 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 549/1078] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:32 2022] GET /compute/v2.1/servers/4725f793-67be-47c7-a4c6-07ccb2be4a57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:35:33.399586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:33.400332 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:33.406564 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.407084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.407932 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:33.408437 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:33.574128 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:33.582322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-746bfc4e-967f-4cb6-b510-73042bdf02ec tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1576 microversion: 2.1 time: 0.186943 May 27 03:35:33.582899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 530/1079] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:33 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:34.380594 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-d6712c07-bbaa-405b-8688-5e6f8c2b94c6 req-d36c6b69-fd82-408d-a113-9b83450f92d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd8487d-5eed-4492-b1ce-5a260cc7292f", "name": "network-vif-deleted", "tag": "0043daec-332d-4272-9b40-80a037bc94a6"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:34.390124 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-d6712c07-bbaa-405b-8688-5e6f8c2b94c6 req-d36c6b69-fd82-408d-a113-9b83450f92d3 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.390568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-d6712c07-bbaa-405b-8688-5e6f8c2b94c6 req-d36c6b69-fd82-408d-a113-9b83450f92d3 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.403306 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-d6712c07-bbaa-405b-8688-5e6f8c2b94c6 req-d36c6b69-fd82-408d-a113-9b83450f92d3 service nova] Creating event network-vif-deleted:0043daec-332d-4272-9b40-80a037bc94a6 for instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f on hv-cinder-82880 May 27 03:35:34.409633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-d6712c07-bbaa-405b-8688-5e6f8c2b94c6 req-d36c6b69-fd82-408d-a113-9b83450f92d3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 May 27 03:35:34.410601 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 550/1080] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:34.600491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:34.601688 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:34.608839 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.609649 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.610433 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:34.610876 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:34.685407 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:34.697484 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-0b07b8e9-d6ca-4341-96ef-15a4917bb1f9 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 200 len: 1225 microversion: 2.1 time: 0.101592 May 27 03:35:34.698293 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 531/1081] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:34 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:35.716825 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:35.717522 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 8bd8487d-5eed-4492-b1ce-5a260cc7292f] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:35.726303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:35.726757 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:35.727535 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:35.728009 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:35.744616 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] HTTP exception thrown: Instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f could not be found. May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Request method failure captured: May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f HTTP/1.1 May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEVVO8C6qaG6FH18PPWymXNffParFeL03_EnsgnqwS6FJrySRunze2kOheW0nsl3FEkYErStA-H1BtL-7wDnmdwWW8NTb-O5QWgJVHyhMLVPrfcitaPZOgLdy7APaPc_kfEHnQd6wU6B7mdm55dXs5Taf1F0MQyGaKXfh6Qs2i3IIck May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:35:35.746264 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}] May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-TestVolumeBootPattern-597250560 May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 5c8ad338eb7b47c18dcb86f287e28858 May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f could not be found. May 27 03:35:35.747991 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '8bd8487d-5eed-4492-b1ce-5a260cc7292f'} May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f could not be found. May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:35.748959 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f could not be found. May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f could not be found. May 27 03:35:35.750451 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:35.752572 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Returning 404 to user: Instance 8bd8487d-5eed-4492-b1ce-5a260cc7292f could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:35.753587 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-dbd4f321-ead2-46a3-b30b-9cdb0b7143a8 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f" status: 404 len: 111 microversion: 2.1 time: 0.041833 May 27 03:35:35.754679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 551/1082] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:35 2022] GET /compute/v2.1/servers/8bd8487d-5eed-4492-b1ce-5a260cc7292f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:38.896328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:38.896813 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:38.901045 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-93d94171-bf8d-4a84-bb16-256088d15e20 req-ad303a79-bb7e-4dbd-ab1f-60ba00e9a93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594cf2db-0111-498c-aa48-6e11dbd811d2", "tag": "15a5d120-c2cb-4d46-a227-596e6c129738"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:38.904211 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.904857 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.905840 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.906463 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.911230 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-93d94171-bf8d-4a84-bb16-256088d15e20 req-ad303a79-bb7e-4dbd-ab1f-60ba00e9a93e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:38.911785 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-93d94171-bf8d-4a84-bb16-256088d15e20 req-ad303a79-bb7e-4dbd-ab1f-60ba00e9a93e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:38.926543 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-93d94171-bf8d-4a84-bb16-256088d15e20 req-ad303a79-bb7e-4dbd-ab1f-60ba00e9a93e service nova] Creating event network-changed:15a5d120-c2cb-4d46-a227-596e6c129738 for instance 594cf2db-0111-498c-aa48-6e11dbd811d2 on hv-cinder-82880 May 27 03:35:38.932661 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-93d94171-bf8d-4a84-bb16-256088d15e20 req-ad303a79-bb7e-4dbd-ab1f-60ba00e9a93e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035847 May 27 03:35:38.933269 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 552/1083] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:35:38.939595 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:35:39.029144 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4466cc5b-90b2-46bc-9b1a-025e234313f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 204 len: 0 microversion: 2.1 time: 0.136396 May 27 03:35:39.030000 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 532/1084] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:38 2022] DELETE /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:35:39.039466 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:39.040199 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:39.047430 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.047926 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:39.048893 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:39.049656 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:39.198679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:39.206245 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4028065f-fd3f-47fb-98c4-d96906df59f3 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1576 microversion: 2.1 time: 0.172008 May 27 03:35:39.206811 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 553/1085] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:39 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:40.224342 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:40.225041 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:40.231493 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:40.231973 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:40.232733 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:40.233165 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:40.435844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:40.443619 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-98526711-bdb1-4cc8-96d9-df4757cab933 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1576 microversion: 2.1 time: 0.223375 May 27 03:35:40.444931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 533/1086] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:40 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:41.416191 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-1d6d4e87-c432-40dd-a3e8-033c3f0cd66d req-9ff2d2bd-a55f-4d1e-b5cb-5892fb80f820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594cf2db-0111-498c-aa48-6e11dbd811d2", "name": "network-vif-deleted", "tag": "15a5d120-c2cb-4d46-a227-596e6c129738"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:41.424977 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-1d6d4e87-c432-40dd-a3e8-033c3f0cd66d req-9ff2d2bd-a55f-4d1e-b5cb-5892fb80f820 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.425420 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-1d6d4e87-c432-40dd-a3e8-033c3f0cd66d req-9ff2d2bd-a55f-4d1e-b5cb-5892fb80f820 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.436501 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-1d6d4e87-c432-40dd-a3e8-033c3f0cd66d req-9ff2d2bd-a55f-4d1e-b5cb-5892fb80f820 service nova] Creating event network-vif-deleted:15a5d120-c2cb-4d46-a227-596e6c129738 for instance 594cf2db-0111-498c-aa48-6e11dbd811d2 on hv-cinder-82880 May 27 03:35:41.441526 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-1d6d4e87-c432-40dd-a3e8-033c3f0cd66d req-9ff2d2bd-a55f-4d1e-b5cb-5892fb80f820 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029499 May 27 03:35:41.441924 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 554/1087] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:41.462082 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:41.462682 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:41.469470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.469915 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.470668 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:41.471095 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:41.533288 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8ad338eb7b47c18dcb86f287e28858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc47aa302dc4c4e94c4bc7227728c40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:41.541263 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-f5c28ccb-133c-4604-a9cc-60eeed22c505 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 200 len: 1226 microversion: 2.1 time: 0.083474 May 27 03:35:41.541817 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 534/1088] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:41 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:42.559491 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:42.560218 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: 594cf2db-0111-498c-aa48-6e11dbd811d2] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:42.566442 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.566886 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.567633 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:42.568094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:42.581052 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] HTTP exception thrown: Instance 594cf2db-0111-498c-aa48-6e11dbd811d2 could not be found. May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Request method failure captured: May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 HTTP/1.1 May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEVVO8C6qaG6FH18PPWymXNffParFeL03_EnsgnqwS6FJrySRunze2kOheW0nsl3FEkYErStA-H1BtL-7wDnmdwWW8NTb-O5QWgJVHyhMLVPrfcitaPZOgLdy7APaPc_kfEHnQd6wU6B7mdm55dXs5Taf1F0MQyGaKXfh6Qs2i3IIck May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:35:42.582614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}] May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-TestVolumeBootPattern-597250560 May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 5c8ad338eb7b47c18dcb86f287e28858 May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance 594cf2db-0111-498c-aa48-6e11dbd811d2 could not be found. May 27 03:35:42.584286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': '594cf2db-0111-498c-aa48-6e11dbd811d2'} May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594cf2db-0111-498c-aa48-6e11dbd811d2 could not be found. May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:42.585376 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594cf2db-0111-498c-aa48-6e11dbd811d2 could not be found. May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594cf2db-0111-498c-aa48-6e11dbd811d2 could not be found. May 27 03:35:42.586871 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:42.588372 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Returning 404 to user: Instance 594cf2db-0111-498c-aa48-6e11dbd811d2 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:42.588372 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-33e438db-69a8-4c56-abda-55c126baaf37 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2" status: 404 len: 111 microversion: 2.1 time: 0.029107 May 27 03:35:42.588372 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 555/1089] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:42 2022] GET /compute/v2.1/servers/594cf2db-0111-498c-aa48-6e11dbd811d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:35:43.261586 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:43.262096 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:43.269061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.269510 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.270458 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.271048 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.276645 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:43.288253 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] HTTP exception thrown: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Request method failure captured: May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: DELETE /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 HTTP/1.1 May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEVVO8C6qaG6FH18PPWymXNffParFeL03_EnsgnqwS6FJrySRunze2kOheW0nsl3FEkYErStA-H1BtL-7wDnmdwWW8NTb-O5QWgJVHyhMLVPrfcitaPZOgLdy7APaPc_kfEHnQd6wU6B7mdm55dXs5Taf1F0MQyGaKXfh6Qs2i3IIck May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:35:43.290127 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}] May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-TestVolumeBootPattern-597250560 May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: 5c8ad338eb7b47c18dcb86f287e28858 May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.291875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'b74f0adb-3455-49d5-9bae-908876fbd9a9'} May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:43.292804 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.294312 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:35:43.295800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Returning 404 to user: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:43.295800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-1c444636-1f07-44ce-8e97-c0f2abcb01d1 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 404 len: 111 microversion: 2.1 time: 0.033727 May 27 03:35:43.295800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 535/1090] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:35:43 2022] DELETE /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:43.304627 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:43.305230 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] [instance: b74f0adb-3455-49d5-9bae-908876fbd9a9] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:43.311575 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.312052 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.312803 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:43.313233 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:43.327241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.wsgi [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] HTTP exception thrown: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Request method failure captured: May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: request: GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 HTTP/1.1 May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept: application/json May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Accept-Encoding: identity May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Connection: close May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Length: 0 May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Content-Type: application/json May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Host: 10.222.0.62 May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Openstack-System-Scope: None May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: User-Agent: python-urllib3/1.26.9 May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Auth-Token: gAAAAABikEVVO8C6qaG6FH18PPWymXNffParFeL03_EnsgnqwS6FJrySRunze2kOheW0nsl3FEkYErStA-H1BtL-7wDnmdwWW8NTb-O5QWgJVHyhMLVPrfcitaPZOgLdy7APaPc_kfEHnQd6wU6B7mdm55dXs5Taf1F0MQyGaKXfh6Qs2i3IIck May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Id: None May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Domain-Name: None May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Identity-Status: Confirmed May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Is-Admin-Project: True May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Id: default May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Domain-Name: Default May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Project-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Role: member,reader May 27 03:35:43.328794 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Roles: member,reader May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ffc47aa302dc4c4e94c4bc7227728c40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ffc47aa302dc4c4e94c4bc7227728c40"}]}] May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant: tempest-TestVolumeBootPattern-597250560 May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Id: ffc47aa302dc4c4e94c4bc7227728c40 May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-Tenant-Name: tempest-TestVolumeBootPattern-597250560 May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Id: default May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Domain-Name: Default May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Id: 5c8ad338eb7b47c18dcb86f287e28858 May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: X-User-Name: tempest-TestVolumeBootPattern-597250560-project May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: method: > May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: exception: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.330493 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: action_args: {'id': 'b74f0adb-3455-49d5-9bae-908876fbd9a9'} May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:35:43.331379 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. May 27 03:35:43.332912 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: ERROR nova.api.openstack.wsgi May 27 03:35:43.334254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Returning 404 to user: Instance b74f0adb-3455-49d5-9bae-908876fbd9a9 could not be found. {{(pid=117610) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:35:43.334254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-a3256c8b-6066-458f-9806-f06588339935 tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9" status: 404 len: 111 microversion: 2.1 time: 0.029433 May 27 03:35:43.334254 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 556/1091] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:35:43 2022] GET /compute/v2.1/servers/b74f0adb-3455-49d5-9bae-908876fbd9a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:35:44.621228 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-d2746757-e3b9-4add-8861-19ef08727bfe tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] Calling method '.version_select at 0x7f40c05d3670>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:44.629711 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:35:44.643549 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-d2746757-e3b9-4add-8861-19ef08727bfe tempest-TestVolumeBootPattern-597250560 tempest-TestVolumeBootPattern-597250560-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1096312396" status: 202 len: 0 microversion: 2.1 time: 0.026432 May 27 03:35:44.644313 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 536/1092] 10.222.0.62 () {58 vars in 1262 bytes} [Fri May 27 03:35:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1096312396 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:36:09.045416 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1147130334", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "networks": [{"uuid": "40621c29-8759-4117-900c-289582bdfe98"}]}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:09.052390 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:09.053021 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:09.101426 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] validate_networks() for [('40621c29-8759-4117-900c-289582bdfe98', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:36:09.476568 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:36:09.476988 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:36:09.477459 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:36:09.477863 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:36:09.478299 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:36:09.487027 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:09.487470 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:09.488300 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:09.488735 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:09.505387 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Getting quotas for project 207f7211aa65416b8458950bc93ef06a. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:36:09.509257 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Getting quotas for user cb3739622b9d4e40a1efa8b286e01846 and project 207f7211aa65416b8458950bc93ef06a. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:36:09.520429 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:36:09.522622 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:36:09.565901 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6529c50d-4c11-44dd-8065-c49b2256761f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524956 May 27 03:36:09.566784 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 557/1093] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:36:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:36:09.574567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:09.579276 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9a94da0c-9e26-4164-be2b-e875d6c3af4e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:09.579899 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9a94da0c-9e26-4164-be2b-e875d6c3af4e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:09.634887 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9a94da0c-9e26-4164-be2b-e875d6c3af4e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:09.642664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9a94da0c-9e26-4164-be2b-e875d6c3af4e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1214 microversion: 2.1 time: 0.070038 May 27 03:36:09.643416 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 537/1094] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:09 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:10.659338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:10.660001 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:10.667752 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:10.668226 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:10.668979 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:10.669404 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:10.733025 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:10.740765 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-d85f4083-babb-46c2-8d44-8f671014b140 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1272 microversion: 2.1 time: 0.085234 May 27 03:36:10.741326 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 558/1095] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:10 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:11.758508 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:11.759201 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:11.767719 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:11.768190 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:11.768954 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:11.769381 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:11.787167 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-ba675ca4-6f0d-4d2c-8db4-c4e7b8e1ab3e req-5bd5ee0d-7629-4a40-a9e9-1a0c33ca9ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8008749-af0f-4e63-825b-b15c095c9ffb", "tag": "4291dc28-75f9-4a61-a0e7-3be84aa32ca8"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:11.798834 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ba675ca4-6f0d-4d2c-8db4-c4e7b8e1ab3e req-5bd5ee0d-7629-4a40-a9e9-1a0c33ca9ac8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:11.799689 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-ba675ca4-6f0d-4d2c-8db4-c4e7b8e1ab3e req-5bd5ee0d-7629-4a40-a9e9-1a0c33ca9ac8 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:11.812155 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-ba675ca4-6f0d-4d2c-8db4-c4e7b8e1ab3e req-5bd5ee0d-7629-4a40-a9e9-1a0c33ca9ac8 service nova] Creating event network-changed:4291dc28-75f9-4a61-a0e7-3be84aa32ca8 for instance e8008749-af0f-4e63-825b-b15c095c9ffb on hv-cinder-82880 May 27 03:36:11.818004 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-ba675ca4-6f0d-4d2c-8db4-c4e7b8e1ab3e req-5bd5ee0d-7629-4a40-a9e9-1a0c33ca9ac8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037134 May 27 03:36:11.818677 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 559/1096] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:36:11.994538 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:12.002832 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2dfd1bb2-321a-4bc6-86b8-d9a73b394711 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1314 microversion: 2.1 time: 0.248199 May 27 03:36:12.003401 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 538/1097] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:11 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:13.020348 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:13.021051 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:13.028316 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:13.028759 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:13.029513 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:13.029949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:13.162383 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:13.170941 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-4b311251-9955-4c8d-a232-69a1ffbc712a tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1314 microversion: 2.1 time: 0.154808 May 27 03:36:13.171510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 560/1098] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:13 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:14.188359 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:14.188889 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:14.195219 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:14.195661 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:14.196435 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:14.196864 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:14.328341 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:14.335734 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c2c35e8d-000f-457f-9860-54bc280111fb tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1314 microversion: 2.1 time: 0.151253 May 27 03:36:14.336330 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 539/1099] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:14 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:15.352908 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:15.353514 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:15.360015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.360460 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.361207 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.361632 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.485571 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:15.492913 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-c82416cc-9de9-44fe-b3d1-8c9f2bf47857 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1314 microversion: 2.1 time: 0.143841 May 27 03:36:15.493468 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 561/1100] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:15 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:16.510267 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:16.510870 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:16.517863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:16.518334 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.519078 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:16.519504 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.643171 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:16.650552 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-3a63de36-2f60-4db6-9e32-4c3cdd3e930d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1314 microversion: 2.1 time: 0.144065 May 27 03:36:16.651115 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 540/1101] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:16 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:16.921038 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-15080c09-03d6-4214-b6aa-1530b220e990 req-9a087df9-3489-424c-b168-fcde11f84237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8008749-af0f-4e63-825b-b15c095c9ffb", "name": "network-vif-plugged", "status": "completed", "tag": "4291dc28-75f9-4a61-a0e7-3be84aa32ca8"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:16.929043 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-15080c09-03d6-4214-b6aa-1530b220e990 req-9a087df9-3489-424c-b168-fcde11f84237 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:16.929476 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-15080c09-03d6-4214-b6aa-1530b220e990 req-9a087df9-3489-424c-b168-fcde11f84237 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.941111 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-15080c09-03d6-4214-b6aa-1530b220e990 req-9a087df9-3489-424c-b168-fcde11f84237 service nova] Creating event network-vif-plugged:4291dc28-75f9-4a61-a0e7-3be84aa32ca8 for instance e8008749-af0f-4e63-825b-b15c095c9ffb on hv-cinder-82880 May 27 03:36:16.945943 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-15080c09-03d6-4214-b6aa-1530b220e990 req-9a087df9-3489-424c-b168-fcde11f84237 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156640 May 27 03:36:16.946514 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 562/1102] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:17.668667 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:17.669262 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:17.675743 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:17.676213 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:17.676969 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:17.677394 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:17.806843 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:17.814525 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-9771d0ba-3198-4b12-9351-10d3805a44e3 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1314 microversion: 2.1 time: 0.150323 May 27 03:36:17.815083 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 541/1103] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:17 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:18.831516 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:18.832241 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:18.838898 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:18.839338 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:18.840113 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:18.840542 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:18.972687 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:18.980445 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-71465397-bc86-47fe-a0d6-4b7c2c81073d tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1497 microversion: 2.1 time: 0.153126 May 27 03:36:18.981003 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 563/1104] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:18 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:19.416097 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:19.416604 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:19.423574 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:19.424054 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:19.424800 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:19.425254 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:19.449860 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Going to try to terminate instance {{(pid=117609) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:36:19.521292 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-546dc2d1-5940-4a9d-9d34-b3a353be7f01 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 204 len: 0 microversion: 2.1 time: 0.108627 May 27 03:36:19.521863 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 542/1105] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:36:19 2022] DELETE /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:36:19.530679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:19.531286 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:19.533247 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:19.534002 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=6 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:19.540723 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:19.541151 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:19.541907 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:19.542335 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:19.672099 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:19.679617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-b4264590-ba67-47be-99ee-0d7d0d7a1449 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1503 microversion: 2.1 time: 0.153304 May 27 03:36:19.680213 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 564/1106] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:19 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:20.697185 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:20.697881 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:20.699839 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:20.706302 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:20.706747 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:20.707507 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:20.707976 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:20.833873 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:20.842023 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-5c491351-a53e-4eab-b17b-58f55152da1b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 200 len: 1503 microversion: 2.1 time: 0.148520 May 27 03:36:20.842585 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 543/1107] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:20 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:21.374917 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-209b45be-8e73-45e4-a308-11da6422a9e2 req-874cb41e-a1be-4a6d-a2ec-8c67f6f814e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8008749-af0f-4e63-825b-b15c095c9ffb", "name": "network-vif-deleted", "tag": "4291dc28-75f9-4a61-a0e7-3be84aa32ca8"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:21.383758 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-209b45be-8e73-45e4-a308-11da6422a9e2 req-874cb41e-a1be-4a6d-a2ec-8c67f6f814e4 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:21.384235 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-209b45be-8e73-45e4-a308-11da6422a9e2 req-874cb41e-a1be-4a6d-a2ec-8c67f6f814e4 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:21.395459 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-209b45be-8e73-45e4-a308-11da6422a9e2 req-874cb41e-a1be-4a6d-a2ec-8c67f6f814e4 service nova] Creating event network-vif-deleted:4291dc28-75f9-4a61-a0e7-3be84aa32ca8 for instance e8008749-af0f-4e63-825b-b15c095c9ffb on hv-cinder-82880 May 27 03:36:21.400102 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-209b45be-8e73-45e4-a308-11da6422a9e2 req-874cb41e-a1be-4a6d-a2ec-8c67f6f814e4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029413 May 27 03:36:21.400876 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 565/1108] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:21.859694 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:21.861758 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: e8008749-af0f-4e63-825b-b15c095c9ffb] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:21.867722 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:21.868202 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:21.868949 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:21.869405 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:21.883326 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] HTTP exception thrown: Instance e8008749-af0f-4e63-825b-b15c095c9ffb could not be found. May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Request method failure captured: May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb HTTP/1.1 May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEcnYvs2vdLI1y5s9EDgHbFEXzo31dVPBfxBUq0pljUw756KC7dCmj9FUkwupKBdcrveXyfe05YXUI9OpgzGgzDhXAtF3Jyk-z8SE2fQdRuCs83fa3chLu84p0_yGXwRIaUPAi8RPN44OmLF-MCeAeHQ2jrlrfKL3ShjcYqqXvZxt7k May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 207f7211aa65416b8458950bc93ef06a May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesActionsTest-1510267432 May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:36:21.885025 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_207f7211aa65416b8458950bc93ef06a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/207f7211aa65416b8458950bc93ef06a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/207f7211aa65416b8458950bc93ef06a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/207f7211aa65416b8458950bc93ef06a"}]}] May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesActionsTest-1510267432 May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 207f7211aa65416b8458950bc93ef06a May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesActionsTest-1510267432 May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesActionsTest-1510267432-project May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: cb3739622b9d4e40a1efa8b286e01846 May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesActionsTest-1510267432-project May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance e8008749-af0f-4e63-825b-b15c095c9ffb could not be found. May 27 03:36:21.886844 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'e8008749-af0f-4e63-825b-b15c095c9ffb'} May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8008749-af0f-4e63-825b-b15c095c9ffb could not be found. May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:36:21.887897 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8008749-af0f-4e63-825b-b15c095c9ffb could not be found. May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8008749-af0f-4e63-825b-b15c095c9ffb could not be found. May 27 03:36:21.889496 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:21.890763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Returning 404 to user: Instance e8008749-af0f-4e63-825b-b15c095c9ffb could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:36:21.890763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-b16715bc-99b9-4a85-ab0f-e86b212d35b6 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb" status: 404 len: 111 microversion: 2.1 time: 0.031713 May 27 03:36:21.890763 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 544/1109] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:21 2022] GET /compute/v2.1/servers/e8008749-af0f-4e63-825b-b15c095c9ffb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:36:21.935412 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1187201554", "imageRef": "cdf462d3-9602-41e7-bab5-88394ba106ec", "flavorRef": "452", "networks": [{"uuid": "40621c29-8759-4117-900c-289582bdfe98"}]}} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:21.986169 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.network.neutron [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] validate_networks() for [('40621c29-8759-4117-900c-289582bdfe98', None, None, None, None, None)] {{(pid=117610) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:36:22.318751 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Flavor limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:36:22.319204 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Image limits 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:36:22.319702 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Flavor pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:36:22.320140 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Image pref 0:0:0 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:36:22.320549 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.virt.hardware [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117610) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:36:22.332058 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:22.332510 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:22.333303 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:22.333742 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:22.350734 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Getting quotas for project 207f7211aa65416b8458950bc93ef06a. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:36:22.354698 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.quota [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Getting quotas for user cb3739622b9d4e40a1efa8b286e01846 and project 207f7211aa65416b8458950bc93ef06a. Resources: {'instances', 'cores', 'ram'} {{(pid=117610) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:36:22.366011 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Going to run 1 instances... {{(pid=117610) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:36:22.368348 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cdf462d3-9602-41e7-bab5-88394ba106ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117610) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:36:22.411682 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-dd920840-c49d-4d66-a1df-0fb39f101d0e tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480653 May 27 03:36:22.412363 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 566/1110] 10.222.0.62 () {60 vars in 1146 bytes} [Fri May 27 03:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:36:22.422716 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-de77ad70-ce34-402d-92d0-c750375892db tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:22.423319 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-de77ad70-ce34-402d-92d0-c750375892db tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:22.475664 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-de77ad70-ce34-402d-92d0-c750375892db tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:22.482355 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-de77ad70-ce34-402d-92d0-c750375892db tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1214 microversion: 2.1 time: 0.063991 May 27 03:36:22.482984 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 545/1111] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:22 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:23.500068 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:23.500768 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:23.507361 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:23.507802 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:23.508788 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:23.509219 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:23.572228 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:23.580238 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-f3e907df-3b82-434e-8504-ce5a94d010bf tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1272 microversion: 2.1 time: 0.085091 May 27 03:36:23.580894 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 567/1112] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:23 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:24.598500 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:24.599123 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:24.606875 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:24.607323 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:24.608823 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:24.609258 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:24.614904 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [req-d2b48179-7037-40ac-989c-c58fba242795 req-cade95de-e958-49b0-a3c0-9d65bb0ed0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde9c7f6-221e-4528-a771-bf4b15aae6a8", "tag": "8462475e-ee01-4df5-a0c2-a5b08ac96735"}]} {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:24.624865 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-d2b48179-7037-40ac-989c-c58fba242795 req-cade95de-e958-49b0-a3c0-9d65bb0ed0d4 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:24.625368 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [req-d2b48179-7037-40ac-989c-c58fba242795 req-cade95de-e958-49b0-a3c0-9d65bb0ed0d4 service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:24.636683 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.compute.server_external_events [req-d2b48179-7037-40ac-989c-c58fba242795 req-cade95de-e958-49b0-a3c0-9d65bb0ed0d4 service nova] Creating event network-changed:8462475e-ee01-4df5-a0c2-a5b08ac96735 for instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 on hv-cinder-82880 May 27 03:36:24.641329 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [req-d2b48179-7037-40ac-989c-c58fba242795 req-cade95de-e958-49b0-a3c0-9d65bb0ed0d4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030183 May 27 03:36:24.641909 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 568/1113] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:36:24.843634 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:24.851528 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-c3427451-d638-44b7-bb27-a9999849d9ea tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1314 microversion: 2.1 time: 0.257313 May 27 03:36:24.852072 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 546/1114] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:24 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:25.868943 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:25.869645 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:25.875861 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:25.876317 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:25.877079 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:25.877515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:26.005864 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:26.013375 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-256a6948-2148-40ec-a025-5e75b5f1028f tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1314 microversion: 2.1 time: 0.149181 May 27 03:36:26.014131 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 569/1115] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:25 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:27.030069 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:27.030681 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:27.037470 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:27.037922 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:27.038683 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:27.039114 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:27.167391 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:27.175370 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-e825cde4-aa73-4fc6-8c56-4256b105e12b tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1314 microversion: 2.1 time: 0.149109 May 27 03:36:27.176024 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 547/1116] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:27 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:28.192862 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:28.193475 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:28.199617 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:28.200094 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:28.200854 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:28.201310 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:28.329614 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:28.337074 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-9d7975d1-8c6a-4ee7-9249-52b5af8ba682 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1314 microversion: 2.1 time: 0.148060 May 27 03:36:28.337631 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 570/1117] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:28 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:28.859617 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-8d150a4f-d928-4379-9a0a-5b5905581d62 req-c642ba36-abc5-46a7-90e7-cbde2b26f90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde9c7f6-221e-4528-a771-bf4b15aae6a8", "name": "network-vif-plugged", "status": "completed", "tag": "8462475e-ee01-4df5-a0c2-a5b08ac96735"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:28.869641 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8d150a4f-d928-4379-9a0a-5b5905581d62 req-c642ba36-abc5-46a7-90e7-cbde2b26f90e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:28.870079 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-8d150a4f-d928-4379-9a0a-5b5905581d62 req-c642ba36-abc5-46a7-90e7-cbde2b26f90e service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:28.881322 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-8d150a4f-d928-4379-9a0a-5b5905581d62 req-c642ba36-abc5-46a7-90e7-cbde2b26f90e service nova] Creating event network-vif-plugged:8462475e-ee01-4df5-a0c2-a5b08ac96735 for instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 on hv-cinder-82880 May 27 03:36:28.886324 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-8d150a4f-d928-4379-9a0a-5b5905581d62 req-c642ba36-abc5-46a7-90e7-cbde2b26f90e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031100 May 27 03:36:28.887004 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 548/1118] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:29.354076 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:29.354679 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:29.361361 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:29.361747 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:29.362506 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:29.362928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:29.486874 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:29.494223 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-57c44cb4-fcd0-4acd-9b8c-5cf3ae317344 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1314 microversion: 2.1 time: 0.144035 May 27 03:36:29.494780 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 571/1119] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:29 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:30.512205 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:30.512888 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:30.519722 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:30.520191 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:30.520935 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:30.521358 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:30.647772 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:30.655835 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-82c885a6-a1c2-47e7-9704-e0e9aad76a06 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1497 microversion: 2.1 time: 0.148096 May 27 03:36:30.656401 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 549/1120] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:30 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:31.124372 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:31.124891 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:31.131273 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:31.131745 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:31.132550 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:31.132960 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:31.157928 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Going to try to terminate instance {{(pid=117610) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:36:31.229308 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-6f3eeffb-10d2-41a8-a5ff-780ed675d386 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 204 len: 0 microversion: 2.1 time: 0.109035 May 27 03:36:31.229896 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 572/1121] 10.222.0.62 () {58 vars in 1238 bytes} [Fri May 27 03:36:31 2022] DELETE /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:36:31.238403 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:31.239029 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:31.245061 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:31.245499 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:31.246238 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:31.246665 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:31.376032 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.policy [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117609) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:31.383593 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-2cb794f0-6660-4348-a25e-ebeea92da9d9 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1503 microversion: 2.1 time: 0.149033 May 27 03:36:31.384203 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 550/1122] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:31 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:32.402801 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:32.403498 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:32.406490 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=2 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:32.407167 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG dbcounter [-] [117610] Writing DB stats nova_cell0:SELECT=6 {{(pid=117610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:32.413459 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:32.413905 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:32.414665 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:32.415096 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:32.547515 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:32.555044 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-3697663d-1b24-47d5-91ca-8d9014962b11 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1503 microversion: 2.1 time: 0.156468 May 27 03:36:32.555604 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 573/1123] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:32 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:33.124891 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [req-262c1e8a-cec8-4afe-82a8-54e5d9c4e313 req-a635472d-f551-4f34-a9e4-f4b92519c07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde9c7f6-221e-4528-a771-bf4b15aae6a8", "name": "network-vif-deleted", "tag": "8462475e-ee01-4df5-a0c2-a5b08ac96735"}]} {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:33.128931 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG dbcounter [-] [117609] Writing DB stats nova_cell0:SELECT=2 {{(pid=117609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:33.135095 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-262c1e8a-cec8-4afe-82a8-54e5d9c4e313 req-a635472d-f551-4f34-a9e4-f4b92519c07a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:33.135531 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [req-262c1e8a-cec8-4afe-82a8-54e5d9c4e313 req-a635472d-f551-4f34-a9e4-f4b92519c07a service nova] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:33.146894 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.compute.server_external_events [req-262c1e8a-cec8-4afe-82a8-54e5d9c4e313 req-a635472d-f551-4f34-a9e4-f4b92519c07a service nova] Creating event network-vif-deleted:8462475e-ee01-4df5-a0c2-a5b08ac96735 for instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 on hv-cinder-82880 May 27 03:36:33.151752 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [req-262c1e8a-cec8-4afe-82a8-54e5d9c4e313 req-a635472d-f551-4f34-a9e4-f4b92519c07a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030991 May 27 03:36:33.152306 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 551/1124] 10.222.0.62 () {64 vars in 1317 bytes} [Fri May 27 03:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:33.573317 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.api.openstack.wsgi [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117610) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:33.573907 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.compute.api [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117610) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:33.580506 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:33.580949 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:33.581704 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:33.582134 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:33.614998 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:33.615421 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG oslo_concurrency.lockutils [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117610) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:33.615897 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.objects.instance [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lazy-loading 'fault' on Instance uuid fde9c7f6-221e-4528-a771-bf4b15aae6a8 {{(pid=117610) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:36:33.664536 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: DEBUG nova.policy [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3739622b9d4e40a1efa8b286e01846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207f7211aa65416b8458950bc93ef06a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117610) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:33.671882 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO nova.api.openstack.requestlog [None req-e13aa99c-3d0e-41c5-a39f-c70f24efd8c7 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 200 len: 1304 microversion: 2.1 time: 0.102471 May 27 03:36:33.672447 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: [pid: 117610|app: 0|req: 574/1125] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:33 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:36:34.690392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Calling method '>' {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:34.691084 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.compute.api [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] [instance: fde9c7f6-221e-4528-a771-bf4b15aae6a8] Fetching instance by UUID {{(pid=117609) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:34.697281 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:34.697723 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:34.698472 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:34.698904 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG oslo_concurrency.lockutils [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Lock "e6fa4d8a-1bf5-4bf6-a1c9-f9c6e47fb5a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:34.711744 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.wsgi [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] HTTP exception thrown: Instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 could not be found. May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Request method failure captured: May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: request: GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 HTTP/1.1 May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept: application/json May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Accept-Encoding: identity May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Connection: close May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Length: 0 May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Content-Type: application/json May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Host: 10.222.0.62 May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Openstack-System-Scope: None May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: User-Agent: python-urllib3/1.26.9 May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Auth-Token: gAAAAABikEcnYvs2vdLI1y5s9EDgHbFEXzo31dVPBfxBUq0pljUw756KC7dCmj9FUkwupKBdcrveXyfe05YXUI9OpgzGgzDhXAtF3Jyk-z8SE2fQdRuCs83fa3chLu84p0_yGXwRIaUPAi8RPN44OmLF-MCeAeHQ2jrlrfKL3ShjcYqqXvZxt7k May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Id: None May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Domain-Name: None May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Identity-Status: Confirmed May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Is-Admin-Project: True May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Id: default May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Domain-Name: Default May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Id: 207f7211aa65416b8458950bc93ef06a May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Project-Name: tempest-VolumesActionsTest-1510267432 May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Role: member,reader May 27 03:36:34.713328 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Roles: member,reader May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_207f7211aa65416b8458950bc93ef06a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/207f7211aa65416b8458950bc93ef06a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/207f7211aa65416b8458950bc93ef06a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/207f7211aa65416b8458950bc93ef06a"}]}] May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant: tempest-VolumesActionsTest-1510267432 May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Id: 207f7211aa65416b8458950bc93ef06a May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-Tenant-Name: tempest-VolumesActionsTest-1510267432 May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User: tempest-VolumesActionsTest-1510267432-project May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Id: default May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Domain-Name: Default May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Id: cb3739622b9d4e40a1efa8b286e01846 May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: X-User-Name: tempest-VolumesActionsTest-1510267432-project May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: method: > May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: exception: Instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 could not be found. May 27 03:36:34.714927 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: action_args: {'id': 'fde9c7f6-221e-4528-a771-bf4b15aae6a8'} May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: {{(pid=117609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 could not be found. May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:36:34.715877 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 could not be found. May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 could not be found. May 27 03:36:34.717491 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: ERROR nova.api.openstack.wsgi May 27 03:36:34.718924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: DEBUG nova.api.openstack.wsgi [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] Returning 404 to user: Instance fde9c7f6-221e-4528-a771-bf4b15aae6a8 could not be found. {{(pid=117609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:36:34.718924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO nova.api.openstack.requestlog [None req-4116c060-be8a-4f2a-99a9-a8b496df09e2 tempest-VolumesActionsTest-1510267432 tempest-VolumesActionsTest-1510267432-project] 10.222.0.62 "GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8" status: 404 len: 111 microversion: 2.1 time: 0.029622 May 27 03:36:34.718924 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: [pid: 117609|app: 0|req: 552/1126] 10.222.0.62 () {58 vars in 1235 bytes} [Fri May 27 03:36:34 2022] GET /compute/v2.1/servers/fde9c7f6-221e-4528-a771-bf4b15aae6a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:38:58.887381 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:38:58.888015 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Fri May 27 03:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:39:11.819567 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:39:11.820063 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Fri May 27 03:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:39:13.223392 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:39:13.224081 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Fri May 27 03:39:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:39:29.127123 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:39:29.127741 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Fri May 27 03:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:40:39.565891 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:40:39.566590 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Fri May 27 03:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:40:54.918830 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:40:54.919450 dv-cinder-828807-4-iscsi devstack@n-api.service[117609]: Fri May 27 03:40:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:42:18.895484 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:42:18.896129 dv-cinder-828807-4-iscsi devstack@n-api.service[117610]: Fri May 27 03:42:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!